@Sainath368  OPTIMIZE and VACUUM are compute-intensive operations, so you can choose a compute-optimized instance like the F series for both drivers and workers, which has a higher CPU-to-memory ratio.

If its UC managed table, I recommend enabling Predictive optimization, which automatically runs VACUUM, OPTIMIZE and ANALYZE on a serverless compute.

Documentation: https://docs.databricks.com/aws/en/optimizations/predictive-optimization