Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-17-2024 11:37 AM - edited 09-17-2024 11:37 AM
Hi @ggsmith ,
If you check the examples, you will notice that dlt.create_streaming_table is more specialized and you may consider it to be your target.
As per documentation:
Check this example:
https://www.reddit.com/r/databricks/comments/1b9jg3t/deduping_a_table_created_via_delta_live/
What you can observe:
- @dlt.table /@dlt.create_table -> it will be used for your source (with readStream is used)
- dlt.create_streaming_table to define your target and then to run dlt.apply_changes specifying source and target
In general @dlt.table / @dlt.create_table is more robust, whereas dlt.create_streaming_table is a form of syntax sygar designed so it is easier to define streaming targets.