<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Dynamic Continuous Data type and new column arrival adopt in silver in DLT in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/dynamic-continuous-data-type-and-new-column-arrival-adopt-in/m-p/177160#M57255</link>
    <description>&lt;P&gt;My source is : Oracle db - Golden gate - kafka - Flink - S3 - bronze - silver - gold&amp;nbsp;&lt;/P&gt;&lt;P&gt;It's a live cdc data, in S3 we have delta tables in string format, bronze also having string format for all tables, it's a DLT pipeline&amp;nbsp;&lt;/P&gt;&lt;P&gt;Now we have to map datatypes and table structure like existing columns and new column arrival in silver dynamically continuously without delay of Microsoft seconds, pipelines and jobs we can not stop.&lt;/P&gt;&lt;P&gt;Note - we have one metadata snapshot table in S3, which we can consume to map in silver&lt;/P&gt;&lt;P&gt;Kindly advise how to achieve this&lt;/P&gt;</description>
    <pubDate>Fri, 20 Nov 2026 23:35:50 GMT</pubDate>
    <dc:creator>Denis12345</dc:creator>
    <dc:date>2026-11-20T23:35:50Z</dc:date>
    <item>
      <title>Dynamic Continuous Data type and new column arrival adopt in silver in DLT</title>
      <link>https://community.databricks.com/t5/data-engineering/dynamic-continuous-data-type-and-new-column-arrival-adopt-in/m-p/177160#M57255</link>
      <description>&lt;P&gt;My source is : Oracle db - Golden gate - kafka - Flink - S3 - bronze - silver - gold&amp;nbsp;&lt;/P&gt;&lt;P&gt;It's a live cdc data, in S3 we have delta tables in string format, bronze also having string format for all tables, it's a DLT pipeline&amp;nbsp;&lt;/P&gt;&lt;P&gt;Now we have to map datatypes and table structure like existing columns and new column arrival in silver dynamically continuously without delay of Microsoft seconds, pipelines and jobs we can not stop.&lt;/P&gt;&lt;P&gt;Note - we have one metadata snapshot table in S3, which we can consume to map in silver&lt;/P&gt;&lt;P&gt;Kindly advise how to achieve this&lt;/P&gt;</description>
      <pubDate>Fri, 20 Nov 2026 23:35:50 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dynamic-continuous-data-type-and-new-column-arrival-adopt-in/m-p/177160#M57255</guid>
      <dc:creator>Denis12345</dc:creator>
      <dc:date>2026-11-20T23:35:50Z</dc:date>
    </item>
  </channel>
</rss>

