Table Properties different for liquid clustering with Databricks version.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-12-2024 07:45 PM
Dear all,
Today, I tried the liquid clustering in Databricks, but after running it with two Databricks engine version, it showed different properties in the catalog explorer.
1. Run with DBR version 14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12) it will show:
clusteringColumns=[["col1"],["col2"]]
2. Run with DBR version 13.3 LTS (includes Apache Spark 3.4.1, Scala 2.12) it will show:
delta.liquid.clusteringColumns=col1,col2
I have a question: Why do we have these differences, and were both case tables successfully enabled for liquid clustering?
Thanks guys!