Databricks Community

databricksero

Hi everyone,I’m running into an issue with a Delta Live Tables (DLT) pipeline that processes a few transformation layers (raw → intermediate → primary → feature).When I trigger the entire pipeline, it fails with the following error:can not infer sche...

databricksero

Thanks for your reply! I also tried this, but also doesn't work unfortunately.Is there by chance a workaround or "hack" to explicitly state the dependency such that the Databricks planner can still figure out the proper order of execution?

Databricks Community

User Stats

User Activity

DLT pipeline fails with “can not infer schema from empty dataset” — works fine when run manually

Re: DLT pipeline fails with “can not infer schema from empty dataset” — works fine when run manually