https://community.databricks.com/t5/data-engineering/what-are-the-join-hints-available-in-spark-3-0-and-how-does-it/m-p/23422#M16155 <P>what are the join hints, available in spark 3.0, and&nbsp;how does&nbsp;it help compare to pervious spark version&nbsp;</P> Thu, 17 Jun 2021 07:28:38 GMT User16826994223 2021-06-17T07:28:38Z https://community.databricks.com/t5/data-engineering/what-are-the-join-hints-available-in-spark-3-0-and-how-does-it/m-p/23422#M16155 <P>what are the join hints, available in spark 3.0, and&nbsp;how does&nbsp;it help compare to pervious spark version&nbsp;</P> Thu, 17 Jun 2021 07:28:38 GMT https://community.databricks.com/t5/data-engineering/what-are-the-join-hints-available-in-spark-3-0-and-how-does-it/m-p/23422#M16155 User16826994223 2021-06-17T07:28:38Z https://community.databricks.com/t5/data-engineering/what-are-the-join-hints-available-in-spark-3-0-and-how-does-it/m-p/23423#M16156 <P>4 types of join hints in Spark 3.0</P><P></P><P>BROADCAST</P><P>MERGE</P><P>SHUFFLE_HASH</P><P>SHUFFLE_REPLICATE_NL</P><P></P><P>May be good idea to enable Adaptive Query Execution which speeds up Spark SQL join during run time</P><P>In Spark 3.0, Adaptive Query Execution comes with below features</P><P></P><P>Dynamically coalescing shuffle partitions</P><P>Dynamically switching join strategies</P><P>Dynamically optimizing skew joins</P><P></P><P>more details on ADE are available <A href="https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html" alt="https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html" target="_blank">here</A>&nbsp;</P> Thu, 17 Jun 2021 14:38:57 GMT https://community.databricks.com/t5/data-engineering/what-are-the-join-hints-available-in-spark-3-0-and-how-does-it/m-p/23423#M16156 Srikanth_Gupta_ 2021-06-17T14:38:57Z