- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-20-2024 08:20 PM
I have 2 tasks (T1 &T2) that run in branch B1 of Repo1.
I have created a new task (depends on T2 ) which points to a different branch B2 of same Repo1.
Is it possible to run them in the same workflow pipeline? When I tried to set this up, databricks changed the entire pipeline repo branch to B2 instead
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-04-2024 12:59 PM
As per docs, this is currently not available:
All tasks in a job must reference the same commit in the remote repository. You must specify only one of the following for a job that uses a remote repository:
-
branch: The name of the branch, for example,
main. -
tag: The tag’s name, for example,
release-1.0.0. -
commit: The hash of a specific commit, for example,
e0056d01.
Reference: https://docs.databricks.com/en/jobs/configure-job.html#git:~:text=branch%3A%20The%20name%20of%20the%....
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-05-2024 06:57 AM
I was to able to find a workaround. Created separate jobs for those that need to be in different branch (testing tasks) and then ran all of them from a new job.