- 1752 Views
- 5 replies
- 3 kudos
Hi there,I'm curious if anyone is able to definitively help me answer how DLT Job Clusters operate/run.For example, the following is my baseline understanding of DLT Job Clusters. If I run a Triggered DLT Pipeline (e.g. daily) the job cluster takes m...
- 1752 Views
- 5 replies
- 3 kudos
Latest Reply
Hey there! Thanks a bunch for being part of our awesome community! We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...
4 More Replies
- 888 Views
- 4 replies
- 2 kudos
Hi there, silly question here but can anyone help me understand what practical purpose does labelling the table_properties with "quality":"<specific_medallion>"? For example: @Dlt.table(
comment="Bronze live streaming table for Test data",
name="...
- 888 Views
- 4 replies
- 2 kudos
Latest Reply
@ChristianRRL, Welcome, and thank you for being a part of our community! We highly value your inquiries, and we applaud your active participation. We kindly invite you to take some time to review the responses provided and select the solution that be...
3 More Replies
- 1284 Views
- 2 replies
- 1 kudos
I'm trying to figure out what's the best way to "de-duplicate" data via DLT. Currently, my only leads are:Manage data quality with Delta Live Tables | Databricks on AWSVia "Drop invalid records"Constraints on Databricks | Databricks on AWSVia "pre-de...
- 1284 Views
- 2 replies
- 1 kudos
Latest Reply
Hey @ChristianRRL ,Based on my understanding you want to de-duplicate your data during your DLT pipeline processing unfortunately I was not able to find a solution to this when I ran into this problem due to the native feature limitations.Limitations...
1 More Replies
