Can we use multiple git repos for a job running multiple tasks?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-14-2022 10:52 AM
I have a job running multiple tasks :
- Task 1 runs a machine learning pipeline from git repo 1
- Task 2 runs an ETL pipeline from git repo 1
Task 2 is actually a generic pipeline and should not be checked in repo 1, and will be made available in another repo where various ETL pipelines are stored.
However I see now that git repos are set up per Job, and not per Task.
Does anyone have a solution for this, which I would suppose is quite a common scenario?
Labels:
- Labels:
-
Git Repo
-
Multiple Tasks
-
Tasks