โ02-07-2024 02:47 AM
I know we have 4 keys max on cluster by () for both z-order and partition keys. I got some issues when adding 4 keys and 1 specific key triggers that error (I was not expecting as this is about Create Table) . Stats makes sense if you need to optimize an existing clustering strategy due to changes on data profile DeltaAnalysisException: Liquid clustering requires clustering columns to have stats
โ02-07-2024 04:57 AM
are you sure the 4 columns you defined for LC are statistics-enabled?
By default, only the first 32 are used. This can be overridden (up or down).
โ02-07-2024 04:01 AM - edited โ02-07-2024 04:02 AM
I'm aware about the feature and definitions. I've created an empty table enabled to LC using 4 keys.
I've got the error "DeltaAnalysisException: Liquid clustering requires clustering columns to have stats"
How its possible if I just created an empty table?
โ02-07-2024 04:57 AM
are you sure the 4 columns you defined for LC are statistics-enabled?
By default, only the first 32 are used. This can be overridden (up or down).
โ02-07-2024 07:45 AM
My table has only 19 columns
โ02-15-2024 03:17 AM
That's correct. One of the cluster keys I was trying to clustering is not on top 32 positions
Thank you
โ02-13-2024 05:10 AM
Any update?
โ09-11-2024 07:53 AM
Is Liquid cluster also helpful for high cardinality columns for a table Join?
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group