cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Can I give different git branches in the same repo for different tasks in a data bricks workflow

DBricksNewbie
New Contributor III

I have 2 tasks (T1 &T2) that run in branch B1 of Repo1.

I have created a new task (depends on T2 ) which points to a different branch B2  of same Repo1.

Is it possible to run them in the same workflow pipeline? When I tried to set this up, databricks changed the entire pipeline repo branch to B2 instead 

1 ACCEPTED SOLUTION

Accepted Solutions

DBricksNewbie
New Contributor III

I was to able to find a workaround. Created separate jobs for those that need to be in different branch (testing tasks) and then ran all of them from a new job.

View solution in original post

2 REPLIES 2

Walter_C
Databricks Employee
Databricks Employee

As per docs, this is currently not available:

All tasks in a job must reference the same commit in the remote repository. You must specify only one of the following for a job that uses a remote repository:

DBricksNewbie
New Contributor III

I was to able to find a workaround. Created separate jobs for those that need to be in different branch (testing tasks) and then ran all of them from a new job.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group