cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

what is the best way to deploy workflows with different notebooks to execute in different workspaces

udara_zure
New Contributor II

I have a workflow in QA workspace that attached one notebook. I need to deploy the same workflow to PRD workspace , with all the notebooks in the azure devops repo and attche and run a different notebook in the PRD workflow.

1 ACCEPTED SOLUTION

Accepted Solutions

saurabh18cs
Valued Contributor III

Hi @udara_zure 

Asset bundles input is a workflow .yml file where you define every setting for your workflow , there you can have different paths for your notebook for each environment. you will be creating multiple yml files . one for each workflow and for each environment.

As you see below notebook_path

saurabh18cs_0-1737102264390.png

 

View solution in original post

3 REPLIES 3

ashraf1395
Valued Contributor

Databricks asset bundles can be a great solution for this. Clear and straightforward. 
https://docs.databricks.com/en/dev-tools/bundles/index.html

Hi,

can I deploy the same workflow and attach a different notebook in the deploy process, in this method?

saurabh18cs
Valued Contributor III

Hi @udara_zure 

Asset bundles input is a workflow .yml file where you define every setting for your workflow , there you can have different paths for your notebook for each environment. you will be creating multiple yml files . one for each workflow and for each environment.

As you see below notebook_path

saurabh18cs_0-1737102264390.png

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group