Liquid clustering with structured streaming pyspark
I would like to try out liquid clustering, but all the examples I see seem to be SQL tables created from selecting from other tables. Our gold tables are pyspark tables written directly to a table, e.g. like this: silver_df.writeStream.partitionBy(["...
- 3879 Views
- 4 replies
- 4 kudos
- 4 kudos
I did not find anything in the docs either. I suppose a pyspark version will come in the future?
- 4 kudos