Databricks Cluster Downsizing time
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-19-2025 12:27 AM
Hello,
It seems that the cluster downsizing at our end is occurring rapidly: sometimes the workers go from 5-3 in mere 2 minutes!
Is that normal? Can I do something to increase this downsizing time?
- Jahanzeb
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-19-2025 12:48 AM
Hi @jahanzebbehan, unfortunately, I don't believe there is any way to decrease the downsizing time for a cluster, as this mostly happens automatically depending on workload volume.
Here are some helpful links on autoscaling:
https://www.databricks.com/blog/2018/05/02/introducing-databricks-optimized-auto-scaling.html
Eni
