Liquid clustering on and dynamic overwrites

radix — Mon, 11 Mar 2024 10:37:30 GMT

I use the following option to write from multiple tasks to the same table with overwrite (in Pyspark)

.option("partitionOverwriteMode", "dynamic")

The table was created with partition by so it works as expected.
I read about liquid clustering and it's benefits over table partitioning
Is it possible to perform the same use case of writing from multiple tasks (simultaneously) to the same table with overwrite on a liquid clustered table?

Thanks

Re: Liquid clustering on and dynamic overwrites

Ranjeet1981 — Sat, 03 Aug 2024 11:42:15 GMT

No it doesn't support partition overwrite.

topic Re: Liquid clustering on and dynamic overwrites in Get Started Discussions

Liquid clustering on and dynamic overwrites

Re: Liquid clustering on and dynamic overwrites