topic Re: Databricks - Workflow- Jobs- Script to automate in Data Engineering

Databricks - Workflow- Jobs- Script to automate

joakon — Wed, 25 Jan 2023 20:25:39 GMT

Hi - I have created a Databricks job - under Workflow - its running fine without any issues . I would like to promote this job to other workspaces using a script.

Is there a way to script the job definition and deploy it across multiple workspaces .I am trying to avoid creating the job manually - basically would like to automate this .

Re: Databricks - Workflow- Jobs- Script to automate

Rishabh-Pandey — Wed, 25 Jan 2023 20:45:42 GMT

If you have unity catalog enabled workspace then you can easily migrate you jobs , from one workspace to another

Re: Databricks - Workflow- Jobs- Script to automate

joakon — Wed, 25 Jan 2023 20:51:43 GMT

Thanks for the response @Rishabh Pandey . But unfortunately we don't.

Re: Databricks - Workflow- Jobs- Script to automate

LandanG — Thu, 26 Jan 2023 01:18:58 GMT

Hi @raghu maremanda ,

The best solution would be a combination of git and IaaC, such as terraform. I'd check out this blog post if you want to read more.

Re: Databricks - Workflow- Jobs- Script to automate

joakon — Fri, 27 Jan 2023 18:04:57 GMT

thank you @Landan George