Liquid clustering within partitions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-18-2024 08:26 PM
As the tables are already partitioned. Is it possible to have liquid clustering within a partition or recreating the table is the only option?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-18-2024 11:34 PM
Hi @sashikanth ,
No, it's not possible to have liquid clustering within a partition. According to documentation:
"You can enable liquid clustering on an existing table or during table creation. Clustering is not compatible with partitioning or ZORDER, and requires that you use Azure Databricks to manage all layout and optimization operations for data in your table. After liquid clustering is enabled, run OPTIMIZE jobs as usual to incrementally cluster data."
https://learn.microsoft.com/en-us/azure/databricks/delta/clustering