Databricks Community

numersoz · 12-07-2022

Hi,I've large Delta Table for IoT data for over 10K different sensors with timestamp, sensor name and value columns at 1 second precision.Query pattern is usually random 5-100 sensors at a time. But typically involves specific year/month/day interval...

numersoz · 11-23-2022

Hi,After appending new values to a delta table, I need to delete duplicate rows.After deleting duplicate rows using PySpark, I overwrite the table (keeping the schema).My question is, do I have to do ZORDER again?Another question, is there another wa...

numersoz · 12-08-2022

Hi,Thank you this helps!

numersoz · 11-24-2022

@Werner Stinckens Thank you!I am triggering Z-Order after table is created. But to be sure, if it is it required to re-do Z-Order after doing an overwrite to Delta Table (with schema overwrite set to false).

Databricks Community

User Stats

User Activity

Z-Ordering Timestamp Column

Is ZORDER required after table overwrite?

Re: Z-Ordering Timestamp Column

Re: Is ZORDER required after table overwrite?