Hi,
I'm trying to test some SQL perf. I run below first
spark.conf.set('spark.databricks.io.cache.enabled', False)
However, the 2nd run for the same query is still way faster than the first time run. Is there a way to make the query start from a clean beginning without any cache?
Thanks