cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Liquid Clustering with Partitioning

Devsh_on_point
New Contributor

Hi Team,

Can we use Partitioning and Liquid Clustering in Conjunction? Essentially, partitioning the table first on a specific field and then apply liquid clustering (on other fields)?

Alternatively, can we define the order priority of the cluster key columns? As I understand, the order of the keys in Cluster By command does not matter. Will this change? 

1 REPLY 1

szymon_dybczak
Contributor III

Hi @Devsh_on_point ,

No, you cant have partitioning and liquid clustering on a table. You can treat liquid clustering as a more performant replacement of partitioning.

And yes, you are correct. Order of cluster columns doesn't matter:

"Databricks recommends choosing clustering keys based on commonly used query filters. Clustering keys can be defined in any order."

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group