https://community.databricks.com/t5/warehousing-analytics/databrics-offers-auto-tuning/m-p/75841#M1418 <P>is databricks offers auto tunning?</P> Wed, 26 Jun 2024 12:22:02 GMT Akshay_Petkar 2024-06-26T12:22:02Z https://community.databricks.com/t5/warehousing-analytics/databrics-offers-auto-tuning/m-p/75841#M1418 <P>is databricks offers auto tunning?</P> Wed, 26 Jun 2024 12:22:02 GMT https://community.databricks.com/t5/warehousing-analytics/databrics-offers-auto-tuning/m-p/75841#M1418 Akshay_Petkar 2024-06-26T12:22:02Z https://community.databricks.com/t5/warehousing-analytics/databrics-offers-auto-tuning/m-p/75891#M1420 <P>Yes,&nbsp;<BR /><BR />First of all, open source spark already has a set of auto-tuning features denominated Adaptive Query Execution (AQE). Here are more details: <A href="https://spark.apache.org/docs/latest/sql-performance-tuning.html#adaptive-query-execution" target="_blank">https://spark.apache.org/docs/latest/sql-performance-tuning.html#adaptive-query-execution</A>.</P> <P>For even better auto-tuning capabilities, Databricks offer it's <A href="https://www.databricks.com/product/photon" target="_self">Photon Engine</A> that is a highly optimized engine for spark that explores spark's AQE features much further than the OSS spark engine.&nbsp;</P> <P><A href="https://www.databricks.com/product/databricks-sql" target="_blank">Databricks SQL</A> is also a highly optimized product that doesn't need manual tuning of your workloads. DBSQL relies on Photon.&nbsp;</P> Wed, 26 Jun 2024 20:02:54 GMT https://community.databricks.com/t5/warehousing-analytics/databrics-offers-auto-tuning/m-p/75891#M1420 raphaelblg 2024-06-26T20:02:54Z