https://community.databricks.com/t5/data-engineering/auto-tuning-capability-available-for-external-tables/m-p/80552#M36062 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/104328">@Amit_Dass_Chmp</a>&nbsp;,</P><P>Yep, according to documentation. As of second question, such capability will be available in the future.</P><P>&nbsp;</P><P><SPAN>If you are using Databricks Runtime 11.3 and above to create <STRONG>managed</STRONG> Delta tables cataloged in&nbsp;</SPAN><A href="https://www.databricks.com/product/unity-catalog" target="_blank" rel="noopener">Unity Catalog</A><SPAN>&nbsp;(Databricks’ data catalog), you don’t need to worry about optimizing the underlying file sizes or configuring a target file size for your Delta tables because Databricks will carry out this task automatically in the background as part of the auto-tuning capability. <STRONG>In the future</STRONG>, this will also be <STRONG>available</STRONG> for <STRONG>external tables</STRONG>.</SPAN></P> Thu, 25 Jul 2024 12:29:12 GMT szymon_dybczak 2024-07-25T12:29:12Z https://community.databricks.com/t5/data-engineering/auto-tuning-capability-available-for-external-tables/m-p/80549#M36061 <P><SPAN>If I am using Databricks Runtime 11.3 and above to create managed Delta tables cataloged in&nbsp;</SPAN><A href="https://www.databricks.com/product/unity-catalog" target="_blank" rel="noopener">Unity Catalog</A><SPAN>&nbsp;(Databricks’ data catalog), I don’t need to worry about optimizing the underlying file sizes or configuring a target file size for my Delta tables because Databricks will carry out this task automatically in the background as part of the auto-tuning capability.</SPAN></P><P>Does Auto-tuning capability available for external tables as well?</P> Thu, 25 Jul 2024 12:21:09 GMT https://community.databricks.com/t5/data-engineering/auto-tuning-capability-available-for-external-tables/m-p/80549#M36061 Amit_Dass_Chmp 2024-07-25T12:21:09Z https://community.databricks.com/t5/data-engineering/auto-tuning-capability-available-for-external-tables/m-p/80552#M36062 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/104328">@Amit_Dass_Chmp</a>&nbsp;,</P><P>Yep, according to documentation. As of second question, such capability will be available in the future.</P><P>&nbsp;</P><P><SPAN>If you are using Databricks Runtime 11.3 and above to create <STRONG>managed</STRONG> Delta tables cataloged in&nbsp;</SPAN><A href="https://www.databricks.com/product/unity-catalog" target="_blank" rel="noopener">Unity Catalog</A><SPAN>&nbsp;(Databricks’ data catalog), you don’t need to worry about optimizing the underlying file sizes or configuring a target file size for your Delta tables because Databricks will carry out this task automatically in the background as part of the auto-tuning capability. <STRONG>In the future</STRONG>, this will also be <STRONG>available</STRONG> for <STRONG>external tables</STRONG>.</SPAN></P> Thu, 25 Jul 2024 12:29:12 GMT https://community.databricks.com/t5/data-engineering/auto-tuning-capability-available-for-external-tables/m-p/80552#M36062 szymon_dybczak 2024-07-25T12:29:12Z