Louis_Frolio
Databricks Employee
Databricks Employee
Based on the provided context, as of now, liquid clustering cannot be enabled directly on materialized views created via a Delta Live Tables (DLT) pipeline. Attempts to set table properties such as "delta.clusterBy" or "delta.liquidClustering.enabled" produce errors because these configurations are not supported. Moreover, using a CLUSTER BY command like ALTER TABLE network_banded_usage CLUSTER BY AUTO through the spark.sql() API also fails in the DLT pipeline context due to unsupported SQL commands in Python-based DLT pipelines.
 
Currently, there is no support for enabling liquid clustering directly on materialized views with syntax in DLT pipelines or associated commands. However, liquid clustering is supported for Delta Lake tables managed through DLT Preview and Current channels, with clustering occurring during DLT maintenance jobs or manually via OPTIMIZE commands. Notably, the actual clustering does not happen on write but is implemented during maintenance operations like OPTIMIZE.
 
Hope this helps, Lou.