Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-23-2021 05:03 PM
Delta Caching is an edge feature available in Databricks. This means it's not available in OSS Spark. Spark caching is also available in Databricks.
At a high level, Delta caching is storing the data in the data disk of the executors for repeated access. Spark caching is storing the data in memory or disk or both for repeated access. The caching mechanism is different in the way eviction and refresh are done.
A comparison is provided here :
https://docs.databricks.com/delta/optimizations/delta-cache.html#delta-and-apache-spark-caching