Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-24-2025 09:14 PM
Hello Team,
I am looking for couple of useful resources to upskill myself on delta late and pyspark performance optimization on databricks. Can anyone suggest or recommend where I can get those resources?
Thanks
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-25-2025 03:03 AM
Try this PySpark Optimization Full Course 2025 [Step-By-Step Guide]
RG #Driving Business Outcomes with Data Intelligence
PySpark | Databricks | Apache Spark | Big Data Engineering In this video, you'll learn PySpark optimization techniques from the ground up - covering everything from PySpark Tutorial, Driver OOM issues, Salting, Adaptive Query Execution, Caching and Persistence, Spark SQL Hints, Broadcast Joins and
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-25-2025 03:34 AM
Hello @daisy65!
+ Resources to build depth in Delta Lake and PySpark performance optimization on Databricks:
- https://docs.databricks.com/aws/en/delta/best-practices
- https://docs.databricks.com/aws/en/lakehouse-architecture/performance-efficiency/best-practices
- Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads
- Academy Course: Apache Spark Developer Learning Plan (free, no labs) or Apache Spark Programming with Databricks (paid, includes labs); includes a focused “Monitoring and Optimizing Apache Spark Workloads on Databricks” module