- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-13-2024 08:04 AM
Hi @ashraf1395 ,
Unfortunately, it’s not possible to achieve this using append_flow or similar approaches across multiple pipelines. Delta Live Tables are designed so that each target table is managed and owned by a single pipeline. This means maintenance, full refreshes, and append operations need to happen within the pipeline that owns the table.
If you need to bring in multiple data sources, consider integrating them into one pipeline and using append_flow there. If you must work with multiple pipelines, make sure only one pipeline owns and manages the target table, and let the other pipelines produce upstream data that the owning pipeline can read and append.