<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Sync Tables: Unity Catalog to Lakebase - Materialized Views triggered mode in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/157922#M54634</link>
    <description>&lt;P&gt;Hi &lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/59366"&gt;@Pat&lt;/a&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Your research on this is spot on! I was actually really curious about this problem and tested it in my own environment to find the exact solution, and I replicated your exact issue.&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;MV creation:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="ShamenParis_0-1780070932559.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/27387i1B3BAA94220A5172/image-size/medium?v=v2&amp;amp;px=400" role="button" title="ShamenParis_0-1780070932559.png" alt="ShamenParis_0-1780070932559.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Sync to Postgres (Snapshot):&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="ShamenParis_1-1780071043601.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/27388iA284F14188EFAB99/image-size/medium?v=v2&amp;amp;px=400" role="button" title="ShamenParis_1-1780071043601.png" alt="ShamenParis_1-1780071043601.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;Here is exactly why this is happening and why you are seeing that error:&lt;/P&gt;&lt;P&gt;The issue comes down to the difference between &lt;STRONG&gt;Triggered&lt;/STRONG&gt; and &lt;STRONG&gt;Snapshot&lt;/STRONG&gt; sync modes for Lakebase Synced Tables:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Snapshot Mode (Works):&lt;/STRONG&gt; This performs a full refresh. It just reads the entire Materialized View as it exists right now and copies it over. It does &lt;I&gt;not&lt;/I&gt; need to track incremental changes, which is why it succeeds perfectly.&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Triggered Mode (Fails):&lt;/STRONG&gt; This performs an incremental sync. To do this, the background sync pipeline &lt;I&gt;must&lt;/I&gt; use Change Data Feed (CDF) to figure out what changed in your MV.&lt;BR /&gt;&lt;SPAN&gt;&lt;BR /&gt;Hope this helps you get your Lakebase sync running!&lt;/SPAN&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Fri, 29 May 2026 16:12:41 GMT</pubDate>
    <dc:creator>ShamenParis</dc:creator>
    <dc:date>2026-05-29T16:12:41Z</dc:date>
    <item>
      <title>Sync Tables: Unity Catalog to Lakebase - Materialized Views triggered mode</title>
      <link>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/157881#M54629</link>
      <description>&lt;P&gt;Hi,&lt;/P&gt;&lt;P&gt;I am facing some issues syncing Materialized Views into Lakebase with triggered mode, and I actually wonder if this is actually possible.&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;create materialized view some_catalog.some_schema.some_table
tblproperties(
  'delta.enableChangeDataFeed' = 'true',
  'pipelines.channel'='PREVIEW')
as
select * from some_catalog_src.some_schema_src.some_table_src limit 100;&lt;/LI-CODE&gt;&lt;P&gt;I've already added params that are needed, you can see below&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Pat_0-1780047815206.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/27367iFAC95F35F5854CF7/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Pat_0-1780047815206.png" alt="Pat_0-1780047815206.png" /&gt;&lt;/span&gt;&lt;BR /&gt;&lt;BR /&gt;when trying to create synced table, I get following error:&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;Incremental sync for table some_catalog_src.some_schema_src.some_table_src requires Auto CDF to identify changes, which is only available in the PREVIEW channel. Set pipeline_channel = PREVIEW to proceed.&lt;/LI-CODE&gt;&lt;P&gt;This materialized view is created manually, but I have also tested on MV created via SDP (in PREVIEW channel).&lt;BR /&gt;&lt;BR /&gt;this works with tables:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;create table some_catalog.some_schema.some_table_tbl
tblproperties(
  'delta.enableChangeDataFeed' = 'true')
as
select * from some_catalog_src.some_schema_src.some_table_tbl_src limit 100;&lt;/LI-CODE&gt;&lt;P&gt;&amp;nbsp;The source for triggered sync needs to have CDF enabled:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Pat_2-1780048797934.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/27369i56EC67D4C0ACB76F/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Pat_2-1780048797934.png" alt="Pat_2-1780048797934.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;and I believe I have this enabled, but just noticed it's in Private Preview, so will need to double check:&lt;BR /&gt;&lt;BR /&gt;&lt;A href="https://www.reddit.com/r/databricks/comments/1rl264r/materialized_view_change_data_feed_cdf_private/" target="_blank" rel="noopener"&gt;https://www.reddit.com/r/databricks/comments/1rl264r/materialized_view_change_data_feed_cdf_private/&lt;/A&gt;&lt;BR /&gt;&lt;BR /&gt;while I wrote this, I will leave it and double check if I have enabled CDF on MVs&lt;/P&gt;</description>
      <pubDate>Fri, 29 May 2026 10:05:34 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/157881#M54629</guid>
      <dc:creator>Pat</dc:creator>
      <dc:date>2026-05-29T10:05:34Z</dc:date>
    </item>
    <item>
      <title>Re: Sync Tables: Unity Catalog to Lakebase - Materialized Views triggered mode</title>
      <link>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/157922#M54634</link>
      <description>&lt;P&gt;Hi &lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/59366"&gt;@Pat&lt;/a&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Your research on this is spot on! I was actually really curious about this problem and tested it in my own environment to find the exact solution, and I replicated your exact issue.&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;MV creation:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="ShamenParis_0-1780070932559.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/27387i1B3BAA94220A5172/image-size/medium?v=v2&amp;amp;px=400" role="button" title="ShamenParis_0-1780070932559.png" alt="ShamenParis_0-1780070932559.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Sync to Postgres (Snapshot):&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="ShamenParis_1-1780071043601.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/27388iA284F14188EFAB99/image-size/medium?v=v2&amp;amp;px=400" role="button" title="ShamenParis_1-1780071043601.png" alt="ShamenParis_1-1780071043601.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;Here is exactly why this is happening and why you are seeing that error:&lt;/P&gt;&lt;P&gt;The issue comes down to the difference between &lt;STRONG&gt;Triggered&lt;/STRONG&gt; and &lt;STRONG&gt;Snapshot&lt;/STRONG&gt; sync modes for Lakebase Synced Tables:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Snapshot Mode (Works):&lt;/STRONG&gt; This performs a full refresh. It just reads the entire Materialized View as it exists right now and copies it over. It does &lt;I&gt;not&lt;/I&gt; need to track incremental changes, which is why it succeeds perfectly.&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Triggered Mode (Fails):&lt;/STRONG&gt; This performs an incremental sync. To do this, the background sync pipeline &lt;I&gt;must&lt;/I&gt; use Change Data Feed (CDF) to figure out what changed in your MV.&lt;BR /&gt;&lt;SPAN&gt;&lt;BR /&gt;Hope this helps you get your Lakebase sync running!&lt;/SPAN&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Fri, 29 May 2026 16:12:41 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/157922#M54634</guid>
      <dc:creator>ShamenParis</dc:creator>
      <dc:date>2026-05-29T16:12:41Z</dc:date>
    </item>
    <item>
      <title>Re: Sync Tables: Unity Catalog to Lakebase - Materialized Views triggered mode</title>
      <link>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/158412#M54702</link>
      <description>&lt;P&gt;Hi,&lt;/P&gt;
&lt;P&gt;For the CDC on Materialised views, as the feature is in private preview at the moment you would need to speak to your account team to get it enabled. You also need to be using DBR 18.1 or above on classic compute for it to work.&lt;/P&gt;
&lt;P&gt;The workaround would be to have the materialized view copied into a standard delta table and use this for the sync. But the snapshot approach may be the most efficient option.&lt;/P&gt;
&lt;P&gt;&lt;BR /&gt;Thanks,&lt;BR /&gt;&lt;BR /&gt;Emma&lt;/P&gt;</description>
      <pubDate>Fri, 05 Jun 2026 15:34:16 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/sync-tables-unity-catalog-to-lakebase-materialized-views/m-p/158412#M54702</guid>
      <dc:creator>emma_s</dc:creator>
      <dc:date>2026-06-05T15:34:16Z</dc:date>
    </item>
  </channel>
</rss>

