ZCube Tags not present in Databricks Delta Tables

Mithos
New Contributor

The design doc for Liquid Clustering for Delta refer to Z-Cube to enable  incremental clustering in batches. This is the link - https://docs.google.com/document/d/1FWR3odjOw4v4-hjFy_hVaNdxHVs4WuK1asfB6M6XEMw/edit?pli=1&tab=t.0.

It is also mentioned that the Z-Cube ID will be added as a tag to the transaction log. I could not locate a Z-Cube ID in the transaction logs for a Liquid Clustered table produced in Databricks. Is the Databricks Delta Liquid Clustering approach to incremental clustering different.

#Liquid Clustering #Databricks

#

Design Doc] Liquid Clustering Author: Date: Motivation 1 Hive-style partitioning 2 ZORDER clustering 2 Terminology 2 Requirements 2 Functional requirements 2 User surface 3 Proposal Sketch 4 Better clustering with Hilbert curves 4 Incremental clustering using ZCube 7 User surface 10 Proto...

VZLA
Databricks Employee
Databricks Employee

Hi @Mithos thanks for the question!

This is the OSS version of LC applicable to OSS Delta. Databricks has a different implementation, so you won't be able to find it in a liquid table written by DBR.