<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Databricks is automatically creating a _apply_changes_storage table in the database when using apply_changes for Delta Live Tables in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28023#M19861</link>
    <description>&lt;P&gt;A workaround could be to disable access to that table to the user who is connecting.&lt;/P&gt;</description>
    <pubDate>Sun, 16 Oct 2022 17:58:21 GMT</pubDate>
    <dc:creator>Hubert-Dudek</dc:creator>
    <dc:date>2022-10-16T17:58:21Z</dc:date>
    <item>
      <title>Databricks is automatically creating a _apply_changes_storage table in the database when using apply_changes for Delta Live Tables</title>
      <link>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28022#M19860</link>
      <description>&lt;P&gt;Hi there,&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;I am using &lt;B&gt;apply_changes &lt;/B&gt;(aka. Delta Live Tables Change Data Capture) and it works fine. However, it seems to automatically create a secondary table in the database metastore called &lt;B&gt;_apply_storage_changes_{tableName}&lt;/B&gt;&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;So for every table I use &lt;B&gt;apply_changes &lt;/B&gt;with I get two tables. For example, if I create a table called &lt;B&gt;item_prices_history&lt;/B&gt;, I will get two tables in the database...&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;1) &lt;B&gt;&lt;I&gt;item_prices_history&lt;/I&gt;&lt;/B&gt;&lt;/P&gt;&lt;P&gt;2) &lt;B&gt;&lt;I&gt;_apply_storage_changes_item_prices_history&lt;/I&gt;&lt;/B&gt;&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper" image-alt="image"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/1380i7DD03E681A056522/image-size/large?v=v2&amp;amp;px=999" role="button" title="image" alt="image" /&gt;&lt;/span&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;This is an issue because Power BI users are getting confused about the purpose of these tables. Ideally the &lt;B&gt;_apply_changes_storage_{tableName} &lt;/B&gt;would not reside in the database. &lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Here are the tables in Power BI:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper" image-alt="image"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/1384i3861BD9DEB5EF526/image-size/large?v=v2&amp;amp;px=999" role="button" title="image" alt="image" /&gt;&lt;/span&gt;Is there a way to stop the tables prefixed with &lt;B&gt;_apply_changes_storage &lt;/B&gt;being created when using &lt;B&gt;apply_changes&lt;/B&gt;?&lt;/P&gt;&lt;P&gt;&lt;/P&gt;&lt;P&gt;Please note, I am using Azure Premium pricing tier (PySpark)&lt;/P&gt;</description>
      <pubDate>Tue, 11 Oct 2022 10:26:13 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28022#M19860</guid>
      <dc:creator>J_M_W</dc:creator>
      <dc:date>2022-10-11T10:26:13Z</dc:date>
    </item>
    <item>
      <title>Re: Databricks is automatically creating a _apply_changes_storage table in the database when using apply_changes for Delta Live Tables</title>
      <link>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28023#M19861</link>
      <description>&lt;P&gt;A workaround could be to disable access to that table to the user who is connecting.&lt;/P&gt;</description>
      <pubDate>Sun, 16 Oct 2022 17:58:21 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28023#M19861</guid>
      <dc:creator>Hubert-Dudek</dc:creator>
      <dc:date>2022-10-16T17:58:21Z</dc:date>
    </item>
    <item>
      <title>Re: Databricks is automatically creating a _apply_changes_storage table in the database when using apply_changes for Delta Live Tables</title>
      <link>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28025#M19863</link>
      <description>&lt;P&gt;Hi - Thanks @Hubert Dudek​&amp;nbsp;I will look into disabling access for the users!&lt;/P&gt;</description>
      <pubDate>Fri, 18 Nov 2022 14:56:48 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/databricks-is-automatically-creating-a-apply-changes-storage/m-p/28025#M19863</guid>
      <dc:creator>J_M_W</dc:creator>
      <dc:date>2022-11-18T14:56:48Z</dc:date>
    </item>
  </channel>
</rss>

