I need to insert pipeline_id and update_id in my Delta Live Table (DLT), the point being to know which pipeline created which row. How can I obtain this information?
I know you can get job_id and run_id from widgets but I don't know if these are the same things as pipeline_id and update_id.
I have a solution with event_hooks using Python but it looks wrong, I do not think it makes sense to listen for events in my DLT pipeline for this purpose.
#dlt