cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

DABs with multi github sources

jano
New Contributor III

I want to deploy a dabs that has dev using a github branch and prod using a github release tag. I can't seem to find a way to make this part dynamic based on the target. 

Things I've tried:

- Setting the git varaible in the databricks.yml

- making the git_branch or git_tag dynamic in the .job.yml

- making the entire git definition dynamic 

I'm not having any success and each one is not allowed. This might work if the git functionality in the databricks.yml file worked consitently or if there was a tag function in it but unfortunately it is only allowing branches.

#databricksassetbundles 
#dabs

1 ACCEPTED SOLUTION

Accepted Solutions

jano
New Contributor III

I ended up finding this discussion which mostly ended up working. 

What was not mentioned is the first resources block should be in the job.yml and the overwrite parameters mentioned below are in the databricks.yml. You cannot put both in the databricks.yml

View solution in original post

2 REPLIES 2

AbhaySingh
Databricks Employee
Databricks Employee

You may want to look into SHA-Based Versioning. For more details, look here:

https://towardsdev.com/ci-cd-strategies-for-databricks-asset-bundles-e4aaf921823e

 

jano
New Contributor III

I ended up finding this discussion which mostly ended up working. 

What was not mentioned is the first resources block should be in the job.yml and the overwrite parameters mentioned below are in the databricks.yml. You cannot put both in the databricks.yml