Issue with DLT Pipelines
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-14-2024 05:26 PM
Hi Team,
We are trying to create DLT pipeline. The scenario is this:-
We already have catalog in unity catalog and under that we have schema called test in which we have 17 tables. Now we are trying to create DLT pipeline and copy the data from those 17 table from test schema to another prd schema.
I already create notebook in which we have this statement
And when i check the prd schema all the tables appears correctly .
I run the DLT job against cluster only.
Has anyone have any idea why this error happened to me OR what will be correct way to run the DLT pipeline.
Any help will be really appreciated.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-19-2024 08:00 AM
Hey @ash_pal!
When you click on the "flow_progress" error in the screenshot you shared, does a pop-up window appear showing the Summary of the pipeline event along with the Error Details? If so, please provide us with the Error details so we can investigate further.
Best regards,
Jéssica Santos
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-19-2024 03:17 PM
Hi Jessy,
Thanks for reply. Please find the error message below