ETL Pipeline work fine, but when executed via Workflow it fails due to StorageAccessError
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-06-2025 10:23 AM - edited 03-06-2025 10:27 AM
I have a fairly simple ETL Pipeline that uses dlt. It streams data from ADLS2 SA and creates materialized view using two tables. It works fine when i execute it on its own. Materialized view is properly refreshed.
Now I wanted to add this as a task to Workflow and I did so, but when i execute the workflow, it fails with the error:
Run result unavailable: run failed with error message
The Azure container does not exist
Any ideas how to troubleshoot/solve it?
Thanks!
Labels:
- Labels:
-
Workflows