<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Is it possible to set order of precedence of spark SQL extensions? in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21315#M14515</link>
    <description>&lt;P&gt;This does help. I tried going through the DataFrameReader as well but ran into the same error, so it seems it is indeed not possible. Thank you @Hubert Dudek​!&lt;/P&gt;</description>
    <pubDate>Fri, 13 May 2022 17:12:08 GMT</pubDate>
    <dc:creator>samrachmiletter</dc:creator>
    <dc:date>2022-05-13T17:12:08Z</dc:date>
    <item>
      <title>Is it possible to set order of precedence of spark SQL extensions?</title>
      <link>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21312#M14512</link>
      <description>&lt;P&gt;I have the iceberg SQL extension installed, but running commands such as MERGE INTO result in the error &lt;/P&gt;&lt;PRE&gt;&lt;CODE&gt;pyspark.sql.utils.AnalysisException: MERGE destination only supports Delta sources.&lt;/CODE&gt;&lt;/PRE&gt;&lt;P&gt;this seems to be due to using &lt;A href="https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html?_ga=2.118084361.1411576470.1651788707-2044037470.1637080172" alt="https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html?_ga=2.118084361.1411576470.1651788707-2044037470.1637080172" target="_blank"&gt;Delta's&lt;/A&gt; MERGE command as opposed to &lt;A href="https://iceberg.apache.org/docs/latest/spark-writes/#merge-into" alt="https://iceberg.apache.org/docs/latest/spark-writes/#merge-into" target="_blank"&gt;Iceberg's&lt;/A&gt;. Is it possible to force use of the Iceberg extension before Databricks' own?&lt;/P&gt;</description>
      <pubDate>Fri, 06 May 2022 18:44:07 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21312#M14512</guid>
      <dc:creator>samrachmiletter</dc:creator>
      <dc:date>2022-05-06T18:44:07Z</dc:date>
    </item>
    <item>
      <title>Re: Is it possible to set order of precedence of spark SQL extensions?</title>
      <link>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21313#M14513</link>
      <description>&lt;P&gt;@Sam Rachmil-Etter​&amp;nbsp;, SQL syntax is "Databricks" one so I am afraid it will not work. CONVERT can transform the iceberg parquet into the delta.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Probably in python/scala it could be better as format("iceberg") can be used in DataFrameReader but I have no experience with iceberg on databricks.&lt;/P&gt;&lt;P&gt;&lt;/P&gt;</description>
      <pubDate>Sat, 07 May 2022 11:02:25 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21313#M14513</guid>
      <dc:creator>Hubert-Dudek</dc:creator>
      <dc:date>2022-05-07T11:02:25Z</dc:date>
    </item>
    <item>
      <title>Re: Is it possible to set order of precedence of spark SQL extensions?</title>
      <link>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21315#M14515</link>
      <description>&lt;P&gt;This does help. I tried going through the DataFrameReader as well but ran into the same error, so it seems it is indeed not possible. Thank you @Hubert Dudek​!&lt;/P&gt;</description>
      <pubDate>Fri, 13 May 2022 17:12:08 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/is-it-possible-to-set-order-of-precedence-of-spark-sql/m-p/21315#M14515</guid>
      <dc:creator>samrachmiletter</dc:creator>
      <dc:date>2022-05-13T17:12:08Z</dc:date>
    </item>
  </channel>
</rss>

