How to capture/Identify Incremental rows when No primary key columns in tables
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-04-2024 04:34 AM
Q1. My source is SQL server tables, I want to identify only latest records(incremental rows) and load those into BRNZE layer. Instead of full load to ADLS, we want to capture only incremental rows and load into ADLS for further processing.
NOTE: Problem here is table has NO PRIMARY KEY column or DATE columns for identification. Could someone please help on this?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-05-2024 06:34 AM
Hi,
what kind of SQL source is it? MS SQL, MySQL, PostgreSQL?
