Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-28-2024 12:21 AM
Hello @lucasrocha,
This is part of my code that does DLT:
table = 'my_table'
schema='my_schema'
@dlt.view(name = table + "_tmp_view")
spark.readStream.table(schema + '.' + table)
dlt.create_streaming_table(name = table)
dlt.apply_changes(
target = table,
source = table + "_tmp_view",
keys = ["id"],
sequence_by = col("updated_at"),
stored_as_scd_type = "1"
)
Best regards,
Ksenija