Transition from partitioned table to Liquid clustered table

mjedy78
New Contributor II

Hi all,
I have a table called classes, which is already partitioned on three different columns. I want to create a Liquid Clustered Table, but as far as I understand from the documentation—and from Dany Lee and his team—it was not possible as of 2024 YouTube Video.

I believe there is still no smooth transition. So, I want to recreate the table, but is the only way to do this by creating a new table, deleting the old one, and moving everything from new_table to the old table’s location?

 

%sql
-- Step1
CREATE TABLE IF NOT EXISTS class_clustered
CLUSTER BY (id, family, result_date)
LOCATION 'my_new_table_location'
AS
SELECT *
FROM class(the main partitioned table);

-- Step2
DROP class

-- Step3
Remove location in dbfs

-- Step4
Move everything from location my_new_table_location --> old location(for class partitioned)

 

Can I overwrite it or do something similar without too much effort? 😃 There are more than 20 tables that need to be converted to Liquid Clustered Tables, so I’m looking for the best approach.

 

Join us on Thursday, December 7 at 10AM PST for an enlightening session on Delta Lake's Liquid Clustering, a transformative approach in data management and optimization with Vítor Teixeira, Senior Data Engineer at Veeva Systems. Liquid Clustering is Delta Lake's answer to the complex challenges of