Coffee77
Honored Contributor II

Note: with managed tables, invalidation of cache is automatic. No need to manual refreshments.

Take a look at this screenshot from Hubert Dudek on how to migrate:

Coffee77_0-1764062194282.png

And here you have more details abouut how disk caching works in collaboration with spark cache along with cache invalidation: https://youtu.be/_vWnH4kmF60?si=m6FAwKnuWP8pkhvW 

 


Lifelong Solution Architect Learner | Coffee & Data
☕ Episode 3 of BOOST DATABRICKS PERFORMANCE SERIES ✅ Goal is to explain clearly what "Databricks Disk Caching" and "Spark Caching" are, what are the key differences and how they can boost performance working together. 👍👍👍👍👍👍👍👍 ✅ Table of Contents 00:00 Introduction 00:55 What is Lazy Apac...