cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Databrics offers auto tuning?

Akshay_Petkar
New Contributor III

is databricks offers auto tunning?

1 ACCEPTED SOLUTION

Accepted Solutions

raphaelblg
Contributor III
Contributor III

Yes, 

First of all, open source spark already has a set of auto-tuning features denominated Adaptive Query Execution (AQE). Here are more details: https://spark.apache.org/docs/latest/sql-performance-tuning.html#adaptive-query-execution.

For even better auto-tuning capabilities, Databricks offer it's Photon Engine that is a highly optimized engine for spark that explores spark's AQE features much further than the OSS spark engine. 

Databricks SQL is also a highly optimized product that doesn't need manual tuning of your workloads. DBSQL relies on Photon. 

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks

View solution in original post

1 REPLY 1

raphaelblg
Contributor III
Contributor III

Yes, 

First of all, open source spark already has a set of auto-tuning features denominated Adaptive Query Execution (AQE). Here are more details: https://spark.apache.org/docs/latest/sql-performance-tuning.html#adaptive-query-execution.

For even better auto-tuning capabilities, Databricks offer it's Photon Engine that is a highly optimized engine for spark that explores spark's AQE features much further than the OSS spark engine. 

Databricks SQL is also a highly optimized product that doesn't need manual tuning of your workloads. DBSQL relies on Photon. 

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!