cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Move Databricks service to another resource group

jeremy98
New Contributor III

Hello,
Is it possible to move in another resource group the databricks service without any problem?

I have a resource group where there are two workspaces the prod and staging environment, I created another resource group to maintain only the databricks staging workspace. I watched that there is an option to move the resource, to another resource group. The rgs stand in the same location and subscription. This could take few minutes? The data in the catalogs are created in an external locations and other things are created automatically.

Thanks for the answer (there isn't any script attached and triggered by a fixed schedule)

5 REPLIES 5

szymon_dybczak
Contributor III

Hi @jeremy98 ,

Unfortunately you can't do that. Databricks workspace move to another resource group is not supported. You can check it at below link: 

https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/move-support-resources

Hi szy,
you give me a bad news.. but it's the right question.. I need to plan the migration of the databricks workspace in another resource group, my catalog-data are inserted in external locations. How can I "migrate" the creation of the workspace in the other resource group (creating it) what steps I need to care to do this task? 

Thanks for answering

jeremy98
New Contributor III

any suggestions? @szymon_dybczak 

Hi @jeremy98 ,

So it depends a bit on your setup and requirements. If you have all your code commited to repository then the easiest way is to just recreate workspace and all UC assets from scratch and reload tables. 
What are your requirements? Do you have managed tables in UC or external tables? Can you reload data from scratch?

jeremy98
New Contributor III

Hi @szymon_dybczak,

Yes, the settings and creation are handled in Terraform.

We are using UC while leaving Databricks to manage the UC metastore, so the tables are managed. (Is this something we need to handle on our side?)

For table creation, Iโ€™ve set up a catalog thatโ€™s based on an external location. Inside the storage account, there is a folder called "ucmetastore," and within that, you'll find subfolders corresponding to the tables created and managed by UC.

From scratch now I'm worried because takes to much time, ingest the data so I prefer loading them from files already existed.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group