cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Liquid Clustering with Partitioning

Devsh_on_point
New Contributor

Hi Team,

Can we use Partitioning and Liquid Clustering in Conjunction? Essentially, partitioning the table first on a specific field and then apply liquid clustering (on other fields)?

Alternatively, can we define the order priority of the cluster key columns? As I understand, the order of the keys in Cluster By command does not matter. Will this change? 

1 REPLY 1

szymon_dybczak
Esteemed Contributor III

Hi @Devsh_on_point ,

No, you cant have partitioning and liquid clustering on a table. You can treat liquid clustering as a more performant replacement of partitioning.

And yes, you are correct. Order of cluster columns doesn't matter:

"Databricks recommends choosing clustering keys based on commonly used query filters. Clustering keys can be defined in any order."

 

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now