https://community.databricks.com/t5/data-engineering/any-suggestions-around-automating-sizing-of-clusters-and-best/m-p/18064#M11933 <P>Any suggestions around automating sizing of clusters and best practices around it? Other than enabling auto scaling, are there any other practices around creating a right size driver/worker nodes?</P> Thu, 09 Jun 2022 16:32:19 GMT harsha4u 2022-06-09T16:32:19Z https://community.databricks.com/t5/data-engineering/any-suggestions-around-automating-sizing-of-clusters-and-best/m-p/18064#M11933 <P>Any suggestions around automating sizing of clusters and best practices around it? Other than enabling auto scaling, are there any other practices around creating a right size driver/worker nodes?</P> Thu, 09 Jun 2022 16:32:19 GMT https://community.databricks.com/t5/data-engineering/any-suggestions-around-automating-sizing-of-clusters-and-best/m-p/18064#M11933 harsha4u 2022-06-09T16:32:19Z https://community.databricks.com/t5/data-engineering/any-suggestions-around-automating-sizing-of-clusters-and-best/m-p/18065#M11934 <P>Autoscaling should help in sizing the clusters according to the workload. You may want to consider the recommendations here: <A href="https://docs.databricks.com/clusters/cluster-config-best-practices.html#cluster-sizing-considerations" target="test_blank">https://docs.databricks.com/clusters/cluster-config-best-practices.html#cluster-sizing-considerations</A></P> Tue, 09 Aug 2022 10:17:58 GMT https://community.databricks.com/t5/data-engineering/any-suggestions-around-automating-sizing-of-clusters-and-best/m-p/18065#M11934 User16766737456 2022-08-09T10:17:58Z