Delta Live Table pipeline failure - Table missing

Manjula_Ganesap
Contributor

Hi All,

I set up a DLT pipeline to create 58 bronze tables and a subsequent DLT live table that joins the 58 bronze tables created in the first step. The pipeline runs successfully most times.

My issue is that the pipeline fails once every 3/4 runs saying that a table is missing - but when i rerun without any code change - it completes successfully. I'm not sure what is happening.

I face the issue - both while running from UI and ADP (full refresh enabled)

Manjula_Ganesap_0-1692373291621.pngManjula_Ganesap_1-1692373340027.png

from the screenshot: both of the tables are created in the first step.

Any guidance would be really helpful and appreciated. Thank you.