Hello @daisy65!

+ Resources to build depth in Delta Lake and PySpark performance optimization on Databricks:

• https://docs.databricks.com/aws/en/delta/best-practices
• https://docs.databricks.com/aws/en/lakehouse-architecture/performance-efficiency/best-practices
• Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads
• Academy Course: Apache Spark Developer Learning Plan (free, no labs) or Apache Spark Programming with Databricks (paid, includes labs); includes a focused “Monitoring and Optimizing Apache Spark Workloads on Databricks” module