06-16-2023 04:20 AM
In addition to Vinay's answer, you should also check for the Best practices for cluster configurations as clusters play an important role in improving job performance.
https://docs.databricks.com/clusters/cluster-config-best-practices.html
View solution in original post
