<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Managed table conversion and vacuum in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/managed-table-conversion-and-vacuum/m-p/169547#M56123</link>
    <description>&lt;P&gt;Hello everyone,&lt;/P&gt;&lt;P&gt;I am looking for clarification about the 14-day rollback period after converting an external table to a managed table using:&lt;/P&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; ALTER TABLE &amp;lt;table_name&amp;gt; SET MANAGED&lt;/DIV&gt;&lt;SPAN&gt;Databricks documentation states that the conversion can be rolled back within 14 days. It also says that, after this period, Predictive Optimization or a manual&lt;/SPAN&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;SPAN&gt;can delete data from the old external location to avoid unnecessary storage costs.&lt;/SPAN&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;P&gt;I would appreciate clarification on these scenarios:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Running&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;before day 14&lt;/STRONG&gt;&lt;BR /&gt;If I run&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;before the 14-day rollback period ends, does it affect only files in the new managed-table location? Or can it also delete files from the original external location?&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Retention period shorter than 14 days&lt;/STRONG&gt;&lt;BR /&gt;If&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;delta.deletedFileRetentionDuration&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;is set to less than 14 days, for example 7 days:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Does the rollback window become 7 days?&lt;/LI&gt;&lt;LI&gt;If I run&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;on day 8, could it delete data needed for rollback, or it will just affects the data in the managed location?&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Retention period longer than 14 days&lt;/STRONG&gt;&lt;BR /&gt;If&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;delta.deletedFileRetentionDuration&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;is set to more than 14 days, for example 20 days:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Does the rollback window remain 14 days or extend to 20 days?&lt;/LI&gt;&lt;LI&gt;If I run&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;on day 16, could it delete files from the original external location?&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;My assumptions are that the rollback period is fixed to 14 days so, if you run vacuum before that period will not touch the data in the external location no matter the retention-days. If the retention is more than 20 days and if I run a vacuum or PO kicks in, the data in old location will be deleted.&amp;nbsp;&lt;/P&gt;&lt;P&gt;Has anyone tested these cases or received clarification from Databricks? I could not find details about how the rollback period interacts with&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;delta.deletedFileRetentionDuration, manual&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM, and Predictive Optimization.&lt;/P&gt;&lt;P&gt;Thanks for any guidance.&lt;/P&gt;</description>
    <pubDate>Wed, 23 Sep 2026 09:27:31 GMT</pubDate>
    <dc:creator>Davide</dc:creator>
    <dc:date>2026-09-23T09:27:31Z</dc:date>
    <item>
      <title>Managed table conversion and vacuum</title>
      <link>https://community.databricks.com/t5/data-engineering/managed-table-conversion-and-vacuum/m-p/169547#M56123</link>
      <description>&lt;P&gt;Hello everyone,&lt;/P&gt;&lt;P&gt;I am looking for clarification about the 14-day rollback period after converting an external table to a managed table using:&lt;/P&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; ALTER TABLE &amp;lt;table_name&amp;gt; SET MANAGED&lt;/DIV&gt;&lt;SPAN&gt;Databricks documentation states that the conversion can be rolled back within 14 days. It also says that, after this period, Predictive Optimization or a manual&lt;/SPAN&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;SPAN&gt;can delete data from the old external location to avoid unnecessary storage costs.&lt;/SPAN&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;P&gt;I would appreciate clarification on these scenarios:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Running&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;before day 14&lt;/STRONG&gt;&lt;BR /&gt;If I run&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;before the 14-day rollback period ends, does it affect only files in the new managed-table location? Or can it also delete files from the original external location?&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Retention period shorter than 14 days&lt;/STRONG&gt;&lt;BR /&gt;If&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;delta.deletedFileRetentionDuration&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;is set to less than 14 days, for example 7 days:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Does the rollback window become 7 days?&lt;/LI&gt;&lt;LI&gt;If I run&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;on day 8, could it delete data needed for rollback, or it will just affects the data in the managed location?&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Retention period longer than 14 days&lt;/STRONG&gt;&lt;BR /&gt;If&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;delta.deletedFileRetentionDuration&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;is set to more than 14 days, for example 20 days:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Does the rollback window remain 14 days or extend to 20 days?&lt;/LI&gt;&lt;LI&gt;If I run&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;on day 16, could it delete files from the original external location?&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;My assumptions are that the rollback period is fixed to 14 days so, if you run vacuum before that period will not touch the data in the external location no matter the retention-days. If the retention is more than 20 days and if I run a vacuum or PO kicks in, the data in old location will be deleted.&amp;nbsp;&lt;/P&gt;&lt;P&gt;Has anyone tested these cases or received clarification from Databricks? I could not find details about how the rollback period interacts with&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;delta.deletedFileRetentionDuration, manual&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;VACUUM, and Predictive Optimization.&lt;/P&gt;&lt;P&gt;Thanks for any guidance.&lt;/P&gt;</description>
      <pubDate>Wed, 23 Sep 2026 09:27:31 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/managed-table-conversion-and-vacuum/m-p/169547#M56123</guid>
      <dc:creator>Davide</dc:creator>
      <dc:date>2026-09-23T09:27:31Z</dc:date>
    </item>
    <item>
      <title>Re: Managed table conversion and vacuum</title>
      <link>https://community.databricks.com/t5/data-engineering/managed-table-conversion-and-vacuum/m-p/175333#M56988</link>
      <description>&lt;P&gt;Hi &lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/259289"&gt;@Davide&lt;/a&gt;, this thread never got a reply, but you asked the same thing in &lt;A href="https://community.databricks.com/t5/data-engineering/set-managed-and-rollback-in-relation-to-vacuum/td-p/169565" target="_blank"&gt;SET MANAGED and rollback in relation to VACUUM&lt;/A&gt; and posted your test result there, so I'm linking it for anyone who lands here first.&lt;/P&gt;&lt;P&gt;Short version: the 14-day rollback window is its own fixed retention for the old external copy. Your test showed that delta.deletedFileRetentionDuration doesn't shorten it or stretch it.&lt;/P&gt;&lt;P&gt;What the docs spell out:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Databricks keeps the data in the old external location for 14 days so you can roll back.&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;Rolling back is ALTER TABLE ... UNSET MANAGED inside that window (DBR 17.3 LTS+ or serverless). Writes made to the managed location after conversion are kept, and you need to restart any streaming jobs afterwards.&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;After 14 days, predictive optimization deletes the old external data. If predictive optimization is off, you run VACUUM on the converted table yourself to reclaim it.&lt;/P&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;PRE&gt;-- roll back within 14 days
ALTER TABLE main.sales.orders UNSET MANAGED;

-- check whether predictive optimization will clean up for you
DESCRIBE TABLE EXTENDED main.sales.orders;  -- look for the Predictive Optimization row&lt;/PRE&gt;&lt;P&gt;If rollback really matters for a table, I'd still keep manual VACUUM jobs off it for the full 14 days. It costs you nothing and you never have to wonder.&lt;/P&gt;</description>
      <pubDate>Mon, 02 Nov 2026 14:39:16 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/managed-table-conversion-and-vacuum/m-p/175333#M56988</guid>
      <dc:creator>Isaac_18</dc:creator>
      <dc:date>2026-11-02T14:39:16Z</dc:date>
    </item>
  </channel>
</rss>

