cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

CICD Databricks

Abhendu
New Contributor II

Hi Team

I was wondering if there is a document or step by step process to promote code in CICD across various environments of code repository (GIT/GITHUB/BitBucket/Gitlab) with DBx support? [Without involving code repository merging capability of the Databricks workspace].

Let me tell you what I am doing.

1/ I have used DBx template to create CICD (https://github.com/Abhendu21/cicd-demo-v3)

2/ This has allowed me to integrate code from my local machine and run unite tests automatically.

3/ Point 1 and point 2 is created without involving git capability of Databricks workspace.

4/ I have the following environments - Dev, SIT, PreProd and Prod

5/ I want to promote code from Dev (where I have created step 1 and 2) to SIT, PreProd and Prod. 

Should I follow a tag based approach to promote code to higher environments? Is there a best approach guide and codes (like yaml) to help with the process?

Also in each environment, the objective is to run a series of environment specific activities (like for SIT, I would like to perform automated testing with Python robot format)

Kind Regards,

Abhendu Chowdhury 

1 ACCEPTED SOLUTION

Accepted Solutions

Anonymous
Not applicable
2 REPLIES 2

Abhendu
New Contributor II

thanks @Kaniz Fatma​ for the response

Anonymous
Not applicable

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group