Liquid Clustering limitation clustering on write does not support source queries that include filter

ShivangiB
New Contributor III

‎03-06-2025 11:23 PM

I have a query :

%sql
insert into ucdata.brz.liquidcluster_table_data
select sum(col1) as col1,col2,sum(col3) as col3 from ucdata.brz.liquidcluster_table_data  group by col2
This query I am running with run time version 13.3 and it is still working.
 
But as per databricks limitation doc it should not work.
Can you please help.
0 Kudos

SantoshJoshi
New Contributor III

‎03-08-2025 04:02 PM

Hi @ShivangiB,

Can you share the definition of your table - ucdata.brz.liquidcluster_table_data?

Curious - why your source and target are the same table? Are you trying to store the different grains of data in the same table?

I think you are referring this article - Use liquid clustering for Delta tables - Azure Databricks | Microsoft Learn

SantoshJoshi_0-1741478498885.png

0 Kudos

ShivangiB
New Contributor III

‎03-10-2025 12:16 AM

Hey @SantoshJoshi , I am just trying too test the limitations specified for some case study. And while testing can't see these limitations so wanted to understand.

it is having 3 columns , col1,col2,col3 having random numbers and col2 is cluster by column.

0 Kudos

ShivangiB
New Contributor III

‎03-11-2025 09:11 PM

Hey Team, can you please help on this

0 Kudos