DLT Pipeline issue - Failed to read dataset .Dataset is not defined in the pipeline.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-27-2023 01:42 AM
Background.
I have created a DLT pipeline in which i am creating a Temorary table. There are 5 temporary tables as such. When i executed these in an independent notebook they all worked fine with DLT.
Now i have merged this notebook ( keeping same exact code) with other bronze layer notebook
Each temporary table is in seperate cell. But with this consolidated notebook i am getting above mentioned error.
So NOT sure what is issue here , if a DLT code which worked independently earlier why it would fail when combined with other bronze layer code.
This is happing due to a feature issue with DLT where we can add multiple notebook but cannot setup a sequence
Thanks