Databricks

Daba · 06-07-2022

I'm trying to build gold level streaming live table based on two streaming silver live tables with left join.This attempt fails with the next error:"Append mode error: Stream-stream LeftOuter join between two streaming DataFrame/Datasets is not suppo...

Daba · 04-10-2022

Hi, I'm exploring the DLT with AutoLoader feature and wondering where are the schema and checkpoint hide? I want to wipe these two to reset/reinitialize the flow but unlike the "regular" AutoLoader the checkpoint and schema folder are not there.Thank...

Daba · 06-12-2022

Thanks Fatma,I do understand the need for watermarks, but I'm just wondering if this supported by SQL syntax?

Daba · 04-26-2022

Thanks Fatma,I still can't find the place where the generated schema stored, but the initial problem is resolved by "Full Refresh" feature of DLT's job. So, I guess I'm ok. Thanks.

Daba · 04-18-2022

I will. Thanks.

Databricks

User Stats

User Activity

DLT streaming table and LEFT JOIN

DLT+AutoLoader: where is the schema and checkpoint hide?

Re: DLT streaming table and LEFT JOIN

Re: DLT+AutoLoader: where is the schema and checkpoint hide?

Re: DLT+AutoLoader: where is the schema and checkpoint hide?