cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

[Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering".

filipniziol
Contributor


[Filter: SPAM] filipniziol's post body matched "sugar", board "data-engineering".


Post Subject: Re: DLT create_table vs create_streaming_table


Post Body:


Hi @ggsmith ,


If you check the examples, you will notice that dlt.create_streaming_table is more specialized and you may consider it to be your target.
As per documentation:


filipniziol_1-1726597509582.pngCheck this example:
https://www.reddit.com/r/databricks/comments/1b9jg3t/deduping_a_table_created_via_delta_live/

What you can observe:

  • @dlt.table /@dlt.create_table -> it will be used for your source (with readStream is used)
  • dlt.create_streaming_table to define your target and then to run dlt.apply_changes specifying source and target


In general @dlt.table / @dlt.create_table is more robust, whereas dlt.create_streaming_table is a form of syntax sugar designed so it is easier to define streaming targets.


Body text "sugar" matched filter pattern "sugar".


Post by User[id=117376,login=filipniziol] was rejected for the following end-user facing error(s):

  • The message body contains sugar, which is not permitted in this community. Please remove this content before sending your post.

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group