Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2024 12:40 AM
Hello @lucasrocha ,
Yes, we are receiving new records in our tables and updated_at is always populated. We are using the same script to read data from foreign catalog and that DLT pipeline is working completely fine
dlt.apply_changes(
target = target_table,
source = source_table,
keys = ["id"],
sequence_by = col("updated_at"),
stored_as_scd_type = "1"
)
Thanks in advance!
Ksenija