<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Implement Delta tables optimized for Databricks SQL service in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/implement-delta-tables-optimized-for-databricks-sql-service/m-p/111950#M44052</link>
    <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/149421"&gt;@joseph_sf&lt;/a&gt;&amp;nbsp;, I assume you are referring to the &lt;A href="https://www.databricks.com/sites/default/files/2024-05/databricks-certified-data-engineer-professional-exam-guide.pdf" target="_blank"&gt;exam guide PDF&lt;/A&gt; file.&lt;/P&gt;
&lt;P&gt;As you assumed, there are different techniques to optimize a Delta table. Some of them are already mentioned in the other bullet points in the same section 1, such as&amp;nbsp;partitioning, zorder, bloom&lt;BR /&gt;filters, and file sizes. And I agree with you; compared to other points, the "Implement Delta tables optimized for Databricks SQL service" sounds like a broader, more generic phrase to me.&lt;/P&gt;
&lt;P&gt;Having said that here are some useful links I can think of:&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;Delta Lake -&amp;nbsp;&lt;A href="https://docs.databricks.com/aws/en/delta/best-practices#use-liquid-clustering-for-optimized-data-skipping" target="_blank"&gt;Best practices&lt;/A&gt;&lt;/LI&gt;
&lt;LI&gt;Delta Lake -&amp;nbsp;&lt;A href="https://docs.databricks.com/aws/en/optimizations/" target="_blank"&gt;Optimization &amp;amp; Performance&lt;/A&gt;&lt;/LI&gt;
&lt;LI&gt;&lt;A href="https://docs.databricks.com/aws/en/compute/photon#supported-operators-expressions-and-data-types" target="_blank"&gt;Photon&lt;/A&gt;&lt;/LI&gt;
&lt;LI&gt;&lt;A href="https://www.databricks.com/discover/pages/optimize-data-workloads-guide#intro" target="_blank"&gt;&lt;SPAN&gt;Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads&lt;/SPAN&gt;&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;Also, the Databricks product keeps rapidly evolving. For example, I cannot find "Liquid clustering" on the exam guide, but &lt;A href="https://docs.databricks.com/aws/en/delta/clustering" target="_blank"&gt;Liquid clustering&lt;/A&gt; is the recommended technique over Hive style partitioning nowadays. It's worth to explorer the latest docs.&lt;/P&gt;
&lt;P&gt;I've passed the exam before, but didn't get 100 score. So please take it as one of possible views. I hope it helps and good luck with your exam!&lt;/P&gt;</description>
    <pubDate>Fri, 07 Mar 2025 02:02:10 GMT</pubDate>
    <dc:creator>koji_kawamura</dc:creator>
    <dc:date>2025-03-07T02:02:10Z</dc:date>
    <item>
      <title>Implement Delta tables optimized for Databricks SQL service</title>
      <link>https://community.databricks.com/t5/data-engineering/implement-delta-tables-optimized-for-databricks-sql-service/m-p/111873#M44021</link>
      <description>&lt;P&gt;This question is on &amp;nbsp;the Databricks Certified Data Engineer Professional exam in section 1: "Implement Delta tables optimized for Databricks SQL service"&lt;/P&gt;&lt;P&gt;I do not understand what is being asked by this question. i would assume that their different ways to optimize a delta table as stated in the prior question. Please clarify.&lt;/P&gt;</description>
      <pubDate>Wed, 05 Mar 2025 22:25:54 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/implement-delta-tables-optimized-for-databricks-sql-service/m-p/111873#M44021</guid>
      <dc:creator>joseph_sf</dc:creator>
      <dc:date>2025-03-05T22:25:54Z</dc:date>
    </item>
    <item>
      <title>Re: Implement Delta tables optimized for Databricks SQL service</title>
      <link>https://community.databricks.com/t5/data-engineering/implement-delta-tables-optimized-for-databricks-sql-service/m-p/111950#M44052</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/149421"&gt;@joseph_sf&lt;/a&gt;&amp;nbsp;, I assume you are referring to the &lt;A href="https://www.databricks.com/sites/default/files/2024-05/databricks-certified-data-engineer-professional-exam-guide.pdf" target="_blank"&gt;exam guide PDF&lt;/A&gt; file.&lt;/P&gt;
&lt;P&gt;As you assumed, there are different techniques to optimize a Delta table. Some of them are already mentioned in the other bullet points in the same section 1, such as&amp;nbsp;partitioning, zorder, bloom&lt;BR /&gt;filters, and file sizes. And I agree with you; compared to other points, the "Implement Delta tables optimized for Databricks SQL service" sounds like a broader, more generic phrase to me.&lt;/P&gt;
&lt;P&gt;Having said that here are some useful links I can think of:&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;Delta Lake -&amp;nbsp;&lt;A href="https://docs.databricks.com/aws/en/delta/best-practices#use-liquid-clustering-for-optimized-data-skipping" target="_blank"&gt;Best practices&lt;/A&gt;&lt;/LI&gt;
&lt;LI&gt;Delta Lake -&amp;nbsp;&lt;A href="https://docs.databricks.com/aws/en/optimizations/" target="_blank"&gt;Optimization &amp;amp; Performance&lt;/A&gt;&lt;/LI&gt;
&lt;LI&gt;&lt;A href="https://docs.databricks.com/aws/en/compute/photon#supported-operators-expressions-and-data-types" target="_blank"&gt;Photon&lt;/A&gt;&lt;/LI&gt;
&lt;LI&gt;&lt;A href="https://www.databricks.com/discover/pages/optimize-data-workloads-guide#intro" target="_blank"&gt;&lt;SPAN&gt;Comprehensive Guide to Optimize Databricks, Spark and Delta Lake Workloads&lt;/SPAN&gt;&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;Also, the Databricks product keeps rapidly evolving. For example, I cannot find "Liquid clustering" on the exam guide, but &lt;A href="https://docs.databricks.com/aws/en/delta/clustering" target="_blank"&gt;Liquid clustering&lt;/A&gt; is the recommended technique over Hive style partitioning nowadays. It's worth to explorer the latest docs.&lt;/P&gt;
&lt;P&gt;I've passed the exam before, but didn't get 100 score. So please take it as one of possible views. I hope it helps and good luck with your exam!&lt;/P&gt;</description>
      <pubDate>Fri, 07 Mar 2025 02:02:10 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/implement-delta-tables-optimized-for-databricks-sql-service/m-p/111950#M44052</guid>
      <dc:creator>koji_kawamura</dc:creator>
      <dc:date>2025-03-07T02:02:10Z</dc:date>
    </item>
  </channel>
</rss>

