Liquid clustering within partitions

sashikanth — Thu, 19 Sep 2024 03:26:24 GMT

As the tables are already partitioned. Is it possible to have liquid clustering within a partition or recreating the table is the only option?

Re: Liquid clustering within partitions

szymon_dybczak — Thu, 19 Sep 2024 06:34:47 GMT

Hi @sashikanth ,

No, it's not possible to have liquid clustering within a partition. According to documentation:

"You can enable liquid clustering on an existing table or during table creation. Clustering is not compatible with partitioning or ZORDER, and requires that you use Azure Databricks to manage all layout and optimization operations for data in your table. After liquid clustering is enabled, run OPTIMIZE jobs as usual to incrementally cluster data."

https://learn.microsoft.com/en-us/azure/databricks/delta/clustering

topic Liquid clustering within partitions in Data Engineering

Liquid clustering within partitions

Re: Liquid clustering within partitions