topic Re: SQL Query execution plan explain and optimize the performance for query run. in Warehousing & Analytics

SQL Query execution plan explain and optimize the performance for query run.

vinaykumar — Fri, 21 Mar 2025 13:02:43 GMT

When we executing SQL query in databricks SQL warehouse editor what will be best practices to optimize the execution plan and get result faster

Re: SQL Query execution plan explain and optimize the performance for query run.

Lakshay — Tue, 14 Feb 2023 17:38:06 GMT

This will mostly depend on the query you are trying to run. Some general optimization recommendations can be found here: https://docs.databricks.com/optimizations/index.html

Additionally, you can also check the SQL plan for factors like Data Skew, type of join etc.

Re: SQL Query execution plan explain and optimize the performance for query run.

Anonymous — Wed, 15 Feb 2023 14:13:06 GMT

It depends on many different things. For the most part, you don't optimize queries. You can optimize the file layout using optimize/binpacking, bloom filters, and zordering but you can't generate stats or influence the query plan.

The idea of "optimizing" has become a bit of a dated way of thinking. Spark has AQE, CBO, and Catalyst do do much of this work for you. Databricks also adds things like disc caching to help too.

Re: SQL Query execution plan explain and optimize the performance for query run.

Anonymous — Mon, 20 Feb 2023 06:14:45 GMT

Hi @vinay kumar

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: SQL Query execution plan explain and optimize the performance for query run.

jose_gonzalez — Thu, 23 Feb 2023 18:23:05 GMT

HI @vinay kumar,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.