https://community.databricks.com/t5/data-engineering/change-data-capture-cdc/m-p/109533#M43342 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/145131">@subhas_hati</a>&nbsp;,</P><P><SPAN>Change data capture (CDC) is a data integration pattern that captures changes made to data in a source system, such as inserts, updates, and deletes. These changes, represented as a list, are commonly referred to as a&nbsp;</SPAN><EM>CDC feed</EM><SPAN>. You can process your data much faster if you operate on a CDC feed, instead of reading the entire source dataset. Transactional databases such as SQL Server, MySQL, and Oracle generate CDC feeds. Delta tables generate their own CDC feed, known as a change data feed (CDF).</SPAN></P><P><SPAN>If you want to find more details, please take a look at below articles:</SPAN></P><P>-&nbsp;<A href="https://docs.databricks.com/en/delta-live-tables/what-is-change-data-capture.html" target="_blank">What is change data capture (CDC)? | Databricks on AWS</A></P><P>-&nbsp;<A href="https://learn.microsoft.com/en-us/azure/databricks/delta/delta-change-data-feed" target="_blank">Use Delta Lake change data feed on Azure Databricks - Azure Databricks | Microsoft Learn</A></P><P>&nbsp;</P> Sun, 09 Feb 2025 16:16:01 GMT szymon_dybczak 2025-02-09T16:16:01Z https://community.databricks.com/t5/data-engineering/change-data-capture-cdc/m-p/109517#M43335 <P>May I know what is a Change Data Capture ?</P> Sun, 09 Feb 2025 00:49:03 GMT https://community.databricks.com/t5/data-engineering/change-data-capture-cdc/m-p/109517#M43335 subhas_hati 2025-02-09T00:49:03Z https://community.databricks.com/t5/data-engineering/change-data-capture-cdc/m-p/109533#M43342 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/145131">@subhas_hati</a>&nbsp;,</P><P><SPAN>Change data capture (CDC) is a data integration pattern that captures changes made to data in a source system, such as inserts, updates, and deletes. These changes, represented as a list, are commonly referred to as a&nbsp;</SPAN><EM>CDC feed</EM><SPAN>. You can process your data much faster if you operate on a CDC feed, instead of reading the entire source dataset. Transactional databases such as SQL Server, MySQL, and Oracle generate CDC feeds. Delta tables generate their own CDC feed, known as a change data feed (CDF).</SPAN></P><P><SPAN>If you want to find more details, please take a look at below articles:</SPAN></P><P>-&nbsp;<A href="https://docs.databricks.com/en/delta-live-tables/what-is-change-data-capture.html" target="_blank">What is change data capture (CDC)? | Databricks on AWS</A></P><P>-&nbsp;<A href="https://learn.microsoft.com/en-us/azure/databricks/delta/delta-change-data-feed" target="_blank">Use Delta Lake change data feed on Azure Databricks - Azure Databricks | Microsoft Learn</A></P><P>&nbsp;</P> Sun, 09 Feb 2025 16:16:01 GMT https://community.databricks.com/t5/data-engineering/change-data-capture-cdc/m-p/109533#M43342 szymon_dybczak 2025-02-09T16:16:01Z