cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Databricks Cluster Downsizing time

jahanzebbehan
New Contributor

Hello,

It seems that the cluster downsizing at our end is occurring rapidly: sometimes the workers go from 5-3 in mere 2 minutes!

Is that normal? Can I do something to increase this downsizing time?

- Jahanzeb

1 REPLY 1

eniwoke
New Contributor III

Hi @jahanzebbehan, unfortunately, I don't believe there is any way to decrease the downsizing time for a cluster, as this mostly happens automatically depending on workload volume.

Here are some helpful links on autoscaling:

https://community.databricks.com/t5/get-started-discussions/understanding-autoscaling-in-databricks-...

https://www.databricks.com/blog/2018/05/02/introducing-databricks-optimized-auto-scaling.html

 

Eni

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now