Databricks Liquid Clustering
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-13-2024 05:30 AM
Liquid Clustering is a combination of Partitioning and Zordering. As we know, partitioning will create folders based on the column values and stores the similar value. I believe Liquid Clustering will not create folders like partitioning, so how it will take care internally?
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-14-2024 05:40 AM
why do you think Liquid Clustering uses Z ordering?
I recommend you read the design paper https://docs.google.com/document/d/1FWR3odjOw4v4-hjFy_hVaNdxHVs4WuK1asfB6M6XEMw/edit#heading=h.skpz7...
Design Doc] Liquid Clustering Author: Date: Motivation 1 Hive-style partitioning 2 ZORDER clustering 2 Terminology 2 Requirements 2 Functional requirements 2 User surface 3 Proposal Sketch 4 Better clustering with Hilbert curves 4 Incremental clustering using ZCube 7 User surface 10 Proto...

