If data from a Delta table is cached in Databricks SQL and the table is altered in the backend, does it invalidate the cache?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-15-2021 02:17 PM
Basically I'm worried about the scenario where data that gets cached on Databricks SQL endpoints becomes out of sync with the source Delta table. If that were to happen and data was read from the cache it would be out of date/incorrect.
Is this a concern? Is there a way that the Databricks SQL endpoint will know the cache needs to be refreshed?
Labels:
- Labels:
-
Delta Cache
-
SQL