Datajoe
Contributor

This link will give you more information including selection process and auto scaling: https://learn.microsoft.com/en-us/azure/databricks/clusters/cluster-config-best-practices.