[Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering".

filipniziol — Tue, 17 Sep 2024 18:36:50 GMT

Post Subject: Re: DLT create_table vs create_streaming_table

Post Body:

Hi @ggsmith ,

If you check the examples, you will notice that dlt.create_streaming_table is more specialized and you may consider it to be your target.
As per documentation:

Check this example:
https://www.reddit.com/r/databricks/comments/1b9jg3t/deduping_a_table_created_via_delta_live/

What you can observe:

@dlt.table /@dlt.create_table -> it will be used for your source (with readStream is used)

dlt.create_streaming_table to define your target and then to run dlt.apply_changes specifying source and target

In general @dlt.table / @dlt.create_table is more robust, whereas dlt.create_streaming_table is a form of syntax sugar designed so it is easier to define streaming targets.

Body text "sugar" matched filter pattern "sugar".

Post by User[id=117376,login=filipniziol] was rejected for the following end-user facing error(s):

The message body contains sugar, which is not permitted in this community. Please remove this content before sending your post.

topic [Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering". in Data Engineering

[Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering".