Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
How does maintenance clusters do the cleanup using optimize, zorder and vacuum. I read that it is handled automatically but how does maintenance cluster know which column to optimize, where do we need to specify that info ?
Thanks @Retired_mod for the response,can you please give me complete syntax of "use zorder". Also do I need to create maintenance cluster or is it automatically done when specifying dlt policy?
