Compute is one of the largest portions of cost in Databricks ETL. There is not written rule to handle this. Based on experience I have put some thumb rule to set the right cluster. Please check below.
https://medium.com/@infinitylearnings1201/a-comprehensive-guide-to-databricks-cluster-strategy-87490...
