Hi @Syleena23 ,
I believe this Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads provides a lot of answers to these questions and can be a great performance tuning and optimization guide in general. Please take a look.
Thank you.
