Delta Live Table Graph different with no change in Notebook code

Manjula_Ganesap
Contributor

‎09-06-2023 05:05 AM

I have a DLT code to create 40+ bronze tables. The tables are created on top of the latest parquet files for each of those tables. 

While executing the pipeline, sometimes I notice that the graph is different than the regular one i see. I do not understand why that happens. 

Graph i expect to see:

Manjula_Ganesap_0-1694001824330.png

Graph i see sometimes:

Manjula_Ganesap_1-1694001865082.png

As you can see from the screenshots - only 2 tables were created in the second run while all 40+ tables were created in the first run. The underlying parquet files were the same in both cases. 

0 Kudos