Any suggestions around automating sizing of clusters and best practices around it? Other than enabling auto scaling, are there any other practices aro...
Any suggestions around automating sizing of clusters and best practices around it? Other than enabling auto scaling, are there any other practices around creating a right size driver/worker nodes?
- 983 Views
- 1 replies
- 2 kudos
Latest Reply
Autoscaling should help in sizing the clusters according to the workload. You may want to consider the recommendations here: https://docs.databricks.com/clusters/cluster-config-best-practices.html#cluster-sizing-considerations
- 2 kudos