cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

[Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering".

filipniziol
Esteemed Contributor


[Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering".


Post Subject: Re: DLT create_table vs create_streaming_table


Post Body:


Hi @ggsmith ,


If you check the examples, you will notice that dlt.create_streaming_table is more specialized and you may consider it to be your target.
As per documentation:


filipniziol_1-1726597509582.pngCheck this example:
https://www.reddit.com/r/databricks/comments/1b9jg3t/deduping_a_table_created_via_delta_live/

What you can observe:

  • @dlt.table /@dlt.create_table -> it will be used for your source (with readStream is used)
  • dlt.create_streaming_table to define your target and then to run dlt.apply_changes specifying source and target


In general @dlt.table / @dlt.create_table is more robust, whereas dlt.create_streaming_table is a form of syntax sugar designed so it is easier to define streaming targets.


Body text "sugar" matched filter pattern "sugar".


Post by User[id=117376,login=filipniziol] was rejected for the following end-user facing error(s):

  • The message body contains sugar, which is not permitted in this community. Please remove this content before sending your post.

0 REPLIES 0

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now