12-04-2024 11:41 AM
Hello,
Is it possible to move in another resource group the databricks service without any problem?
I have a resource group where there are two workspaces the prod and staging environment, I created another resource group to maintain only the databricks staging workspace. I watched that there is an option to move the resource, to another resource group. The rgs stand in the same location and subscription. This could take few minutes? The data in the catalogs are created in an external locations and other things are created automatically.
Thanks for the answer (there isn't any script attached and triggered by a fixed schedule)
12-04-2024 12:23 PM
Hi @jeremy98 ,
Unfortunately you can't do that. Databricks workspace move to another resource group is not supported. You can check it at below link:
https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/move-support-resources
12-05-2024 12:50 AM
Hi szy,
you give me a bad news.. but it's the right question.. I need to plan the migration of the databricks workspace in another resource group, my catalog-data are inserted in external locations. How can I "migrate" the creation of the workspace in the other resource group (creating it) what steps I need to care to do this task?
Thanks for answering
12-05-2024 04:48 AM
any suggestions? @szymon_dybczak
12-05-2024 05:33 AM - edited 12-05-2024 05:40 AM
Hi @jeremy98 ,
So it depends a bit on your setup and requirements. If you have all your code commited to repository then the easiest way is to just recreate workspace and all UC assets from scratch and reload tables.
What are your requirements? Do you have managed tables in UC or external tables? Can you reload data from scratch?
12-05-2024 01:52 PM
Hi @szymon_dybczak,
Yes, the settings and creation are handled in Terraform.
We are using UC while leaving Databricks to manage the UC metastore, so the tables are managed. (Is this something we need to handle on our side?)
For table creation, I’ve set up a catalog that’s based on an external location. Inside the storage account, there is a folder called "ucmetastore," and within that, you'll find subfolders corresponding to the tables created and managed by UC.
From scratch now I'm worried because takes to much time, ingest the data so I prefer loading them from files already existed.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group