Slow queries and oversized clusters cost time and money. Performance optimization on Databricks starts with measuring: find the real bottleneck, let the platform's automatic optimizations do the heavy lifting, and tune by hand only where it pays off.
The catalog offers one Professional-level course, part of the Advanced Data Engineering with Databricks series, in four formats. Start free and self-paced, or go hands-on with a lab or an instructor. ๐
โ The course ยท Professional ยท Data Engineer
Professional ยท 2H to 4H
Databricks Performance Optimization
Learn how to optimize workloads and physical data layout with Spark and Delta Lake, and use the Spark UI to assess performance and debug applications. Topics include streaming, liquid clustering, data skipping, caching, Photon, and more.
Instructor-led also available in English, ๆฅๆฌ่ช, Portuguรชs BR, and ํ๊ตญ์ด.
What you'll learn
01 Measure. Read the Spark UI and Query Profile to find where time is really spent.
02 Lay out your data. Use liquid clustering and data skipping so queries read less.
03 Speed up compute. Put caching and Photon to work, and tune streaming workloads.
04 Debug. Diagnose slow applications and confirm each fix made a difference.