Coffee77
Honored Contributor III

That is only a rough comparison meaning if a given DF is needed by second time, spark caching is tried (first fastest way), otherwise databricks disk caching (second fastest way). Only if both caches are evicted, data from cloud storage is returned again (slowest). This behavior is the important part. Is this ok for you?


Lifelong Solution Architect Learner | Coffee & Data