<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Should I enable Photon on my SQL Endpoint? in Warehousing &amp; Analytics</title>
    <link>https://community.databricks.com/t5/warehousing-analytics/should-i-enable-photon-on-my-sql-endpoint/m-p/24001#M592</link>
    <description>&lt;P&gt;Generally, yes you should enable photon. The majority of functionality is available and will perform extremely well. There are some limitations with it that can be found &lt;A href="https://docs.databricks.com/runtime/photon.html" alt="https://docs.databricks.com/runtime/photon.html" target="_blank"&gt;here&lt;/A&gt;. &lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Limitations: &lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Works on Delta and Parquet tables only for both read and write.&lt;/LI&gt;&lt;LI&gt;Does not support the following data types:&lt;UL&gt;&lt;LI&gt;Map&lt;/LI&gt;&lt;LI&gt;Array&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;LI&gt;Does not support window and sort operators&lt;/LI&gt;&lt;LI&gt;Does not support Spark Structured Streaming.&lt;/LI&gt;&lt;LI&gt;Does not support UDFs.&lt;/LI&gt;&lt;LI&gt;Not expected to improve operations bottlenecked by network or scan I/O.&lt;/LI&gt;&lt;LI&gt;Not expected to improve short-running queries (&amp;lt;2 seconds), for example, against small data.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Advantages: &lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Supports SQL and equivalent DataFrame operations against Delta and Parquet tables.&lt;/LI&gt;&lt;LI&gt;Expected to accelerate queries that process a significant amount of data (100GB+) and include aggregations and joins.&lt;/LI&gt;&lt;LI&gt;Data is accessed repeatedly and likely in the Delta Lake cache.&lt;/LI&gt;&lt;LI&gt;More robust scan performance on tables with many columns and many small files.&lt;/LI&gt;&lt;LI&gt;Faster Delta and Parquet writing using update, delete, merge into, and create table as select, especially for wide tables (hundreds to thousands of columns).&lt;/LI&gt;&lt;LI&gt;Photon replaces sort-merge joins with hash-joins.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&lt;/P&gt;</description>
    <pubDate>Fri, 18 Jun 2021 21:13:50 GMT</pubDate>
    <dc:creator>Ryan_Chynoweth</dc:creator>
    <dc:date>2021-06-18T21:13:50Z</dc:date>
    <item>
      <title>Should I enable Photon on my SQL Endpoint?</title>
      <link>https://community.databricks.com/t5/warehousing-analytics/should-i-enable-photon-on-my-sql-endpoint/m-p/24000#M591</link>
      <description>&lt;P&gt;I see the option to enable Photon when creating a new SQL Endpoint. The description says that enabling it helps speed up up queries, which sounds good, but are there any downsides I need to be aware of?&lt;/P&gt;</description>
      <pubDate>Fri, 21 Mar 2025 12:57:31 GMT</pubDate>
      <guid>https://community.databricks.com/t5/warehousing-analytics/should-i-enable-photon-on-my-sql-endpoint/m-p/24000#M591</guid>
      <dc:creator>User16826992666</dc:creator>
      <dc:date>2025-03-21T12:57:31Z</dc:date>
    </item>
    <item>
      <title>Re: Should I enable Photon on my SQL Endpoint?</title>
      <link>https://community.databricks.com/t5/warehousing-analytics/should-i-enable-photon-on-my-sql-endpoint/m-p/24001#M592</link>
      <description>&lt;P&gt;Generally, yes you should enable photon. The majority of functionality is available and will perform extremely well. There are some limitations with it that can be found &lt;A href="https://docs.databricks.com/runtime/photon.html" alt="https://docs.databricks.com/runtime/photon.html" target="_blank"&gt;here&lt;/A&gt;. &lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Limitations: &lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Works on Delta and Parquet tables only for both read and write.&lt;/LI&gt;&lt;LI&gt;Does not support the following data types:&lt;UL&gt;&lt;LI&gt;Map&lt;/LI&gt;&lt;LI&gt;Array&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;LI&gt;Does not support window and sort operators&lt;/LI&gt;&lt;LI&gt;Does not support Spark Structured Streaming.&lt;/LI&gt;&lt;LI&gt;Does not support UDFs.&lt;/LI&gt;&lt;LI&gt;Not expected to improve operations bottlenecked by network or scan I/O.&lt;/LI&gt;&lt;LI&gt;Not expected to improve short-running queries (&amp;lt;2 seconds), for example, against small data.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Advantages: &lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Supports SQL and equivalent DataFrame operations against Delta and Parquet tables.&lt;/LI&gt;&lt;LI&gt;Expected to accelerate queries that process a significant amount of data (100GB+) and include aggregations and joins.&lt;/LI&gt;&lt;LI&gt;Data is accessed repeatedly and likely in the Delta Lake cache.&lt;/LI&gt;&lt;LI&gt;More robust scan performance on tables with many columns and many small files.&lt;/LI&gt;&lt;LI&gt;Faster Delta and Parquet writing using update, delete, merge into, and create table as select, especially for wide tables (hundreds to thousands of columns).&lt;/LI&gt;&lt;LI&gt;Photon replaces sort-merge joins with hash-joins.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&lt;/P&gt;</description>
      <pubDate>Fri, 18 Jun 2021 21:13:50 GMT</pubDate>
      <guid>https://community.databricks.com/t5/warehousing-analytics/should-i-enable-photon-on-my-sql-endpoint/m-p/24001#M592</guid>
      <dc:creator>Ryan_Chynoweth</dc:creator>
      <dc:date>2021-06-18T21:13:50Z</dc:date>
    </item>
  </channel>
</rss>

