I have a job running multiple tasks :
- Task 1 runs a machine learning pipeline from git repo 1
- Task 2 runs an ETL pipeline from git repo 1
Task 2 is actually a generic pipeline and should not be checked in repo 1, and will be made available in another repo where various ETL pipelines are stored.
However I see now that git repos are set up per Job, and not per Task.
Does anyone have a solution for this, which I would suppose is quite a common scenario?