Transfer of Jobs/ETL Pipelines/Workflows/Workspace Notebooks from One Subscription to another sub

[AJ270990]

We need to transfer the Jobs/ETL Pipelines/Workflows/Workspace Notebooks from One Azure Subscription to another Azure subscription. Manual way of exporting the notebook and jobs is not feasible as we have around 100s of notebook and workflows. Suggest a suitable way

[parvati_sharma8]

we can use Databricks asset Bundles and Teraform

[AJ270990]

@parvati_sharma8 Can you share some links which will provide step by step process to do this?

[parvati_sharma8 · Accepted solution]

https://www.youtube.com/watch?v=DXMr1cdZ6I4

https://docs.databricks.com/dev-tools/bundles/index.html

[Kirankumarbs]

Asset Bundles are definitely a great approach, but as an alternative, if all your resources are already in Git, you can simply sync them to a new subscription.

[Raman_Unifeye]

@AJ270990 - It has to be the combination of Git Repo and Asset Bundles. 

Using DAB, you could have your jobs/clusters definitions in the ADO and then from ADO you could get your code in the new subscription.

[AJ270990]

Thanks @Raman_Unifeye In our case we dont have ADO, so you meant Github actions?

[pradeep_singh]

If you cant use DABS for any reason terraform exporter utility would be helpful as well . 

More information - 
https://www.databricks.com/blog/2022/12/20/reuse-existing-workflows-through-terraform.html
https://medium.com/mphasis-datalytyx/portable-databricks-how-to-migrate-databricks-from-one-cloud-to...

[pradeep_singh]

If you dont have these resource in dabs already writing/testing configuration might be a good amount of work . with terraform exporter utility you can export all the resource from one workspace as terraform code and deploy it to new workspace quite easily with considerable less work .