- 7412 Views
- 4 replies
- 0 kudos
Delete and Recreate Metastore in Same Region
We have an existing metastore in a region. We would like to delete it (Create a Unity Catalog metastore - Azure Databricks | Microsoft Learn) and create a new metastore in that same region. Are there any issues that we should be aware of with creatin...
- 7412 Views
- 4 replies
- 0 kudos
- 0 kudos
I have exactly the same query.But before that, is it at all a good practice to delete the default metastore ? I am asking this because Databricks creates a lot of things on the Azure side like a storage account, access connector, managed identity, li...
- 0 kudos
- 14483 Views
- 13 replies
- 18 kudos
Resolved! Unity Catalog - multiple metastore in same region
Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...
- 14483 Views
- 13 replies
- 18 kudos
- 18 kudos
I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.
- 18 kudos
- 6042 Views
- 7 replies
- 1 kudos
How to Import an old Unity Catalog Metastore to a new Unity Catalog Metastore?
Hi All,I have created a new Unity Catalog (UC) metastore (new metastore ID) in west europe and now i want to import alle catalog/schema/tables form the old metastore (west europe) container to the new UC metastore.Note: coping all tables form the old...
- 6042 Views
- 7 replies
- 1 kudos
- 1 kudos
Hi @Barney, To import all catalog/schema/tables from the old metastore to the new Unity Catalog (UC) metastore, you can use the Data Explorer upgrade wizard provided by Databricks. Here are the steps: 1. Open the Data Explorer by clicking Data in th...
- 1 kudos
- 8631 Views
- 11 replies
- 11 kudos
Resolved! Metastore creation - Azure Databricks - Access validation failed
Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...
- 8631 Views
- 11 replies
- 11 kudos
- 11 kudos
I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.
- 11 kudos
- 3596 Views
- 2 replies
- 1 kudos
Metastore creation error
This path doesn't exist or we couldn't access it with the credential provided. Metastores require a directory path.Hello Team, Trying to create metasotre, followed the databricks community document encountering above error. Please help me in resolvin...
- 3596 Views
- 2 replies
- 1 kudos
- 1 kudos
To resolve the error, you can follow these steps: Verify the directory path: Ensure that the directory path you provided for the Metastore exists and is accessible. Double-check the path and make sure it is correct. Check the credentials: Ensure th...
- 1 kudos
- 1975 Views
- 2 replies
- 1 kudos
Resolved! Not able to get json response for "/api/2.0/accounts/{account_id}/metastores" endpoint.
Hi ,I am trying to get list of all the metastores associated with an accountId. For this I am using the below REST API to get data:accountId = json.loads(dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson())["tags"]["accountId"]...
- 1975 Views
- 2 replies
- 1 kudos
- 1 kudos
Apparently, it is working if I add the header `X-Databricks-Account-Console-API-Version` with value `2.0` to the call
- 1 kudos
- 1980 Views
- 2 replies
- 0 kudos
Metastore down events in Databricks Workspace
Hi all,I see a number of metastore down events in databricks workspace: do any one know what's the reason why this happens?Thanks,Barney
- 1980 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Ron Barneveld​ Could you kindly help with more details? Is this is a production metastore that you are mentioning or any metastore created by you for test environment. Also where it is hosted?
- 0 kudos
- 7732 Views
- 1 replies
- 5 kudos
Create Metastore. Missing permissions: The associated credential does not grant permission to perform all necessary operations.
Cloud: AWSRegion: eu-west-1S3 location: s3://databricks-dev-bucketIAM role ARN: arn:aws:iam::18XXXXXXXX29:role/databricks-s3-metastoreGuide followed: ref: https://docs.databricks.com/data-governance/unity-catalog/get-started.html#cloud-tenant-setup-a...
- 7732 Views
- 1 replies
- 5 kudos
- 5 kudos
Bump. @Yeshaswini P V​ @Gokul Kumar P​
- 5 kudos
- 4172 Views
- 4 replies
- 1 kudos
Resolved! How to create a new metastore?
Hi,I want to configure Unity Catalog and one step is creating a metastore in the region where I create databricks workspace (I am on Azure). I created a workspace with a premium pricing tier and I am the admin. Following the documentation, I should g...
- 4172 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Mohammad Saber​ Glad to hear that!Please mark the answer as best. It will be highly grateful.Thanks
- 1 kudos
- 5344 Views
- 4 replies
- 0 kudos
Resolved! Cant make Unity Catalog work on Azure
HelloI have created the metastore, linked it to the worskpace, my account is admin in Azure and Databricks, followed these instructions:link1link2link3But when I try to create a table (granting privileges to use catalog, create schemas and create tab...
- 5344 Views
- 4 replies
- 0 kudos
- 0 kudos
I finally made it work.It seems that although after configuring the metastore to work with a manged identity, the metastore must be upgraded with this guide.
- 0 kudos
- 1330 Views
- 2 replies
- 0 kudos
Delta Sharing within the same region
Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...
- 1330 Views
- 2 replies
- 0 kudos
- 0 kudos
If the two Workspaces are under the same metastore you don't need Delta Sharing because they already have access to the same data. Unless you want to do data segregation per workspace. if it's the case it's coming soon at the end of february
- 0 kudos
- 2325 Views
- 4 replies
- 9 kudos
Unity Catalog - Metastore is it at account or workspace
I was trying to understand Unity Catalog, if metastore is at the account level or the each workspace in the account will have there own metastore? My understanding is the metastore cant be shared between two workspace.
- 2325 Views
- 4 replies
- 9 kudos
- 9 kudos
@Sanjay Janardhan​ , no i have done this, you can share it in multiple workspaces
- 9 kudos
- 12830 Views
- 13 replies
- 4 kudos
Problems with Unity Catalog
Hello.I am using Azure Databricks since a few months and I want to add a Unity Catalog.Unfortunately, I have some problems:1. I am not able to create a Unity Catalog Cluster with settings:- Policy: Unrestricted- Multi Node with Single user access mod...
- 12830 Views
- 13 replies
- 4 kudos
- 4 kudos
I'm facing the same issues as other customers listed above. I do not have the "Create Metastore" button available.
- 4 kudos
- 3093 Views
- 2 replies
- 4 kudos
Resolved! unity catalog databricks_metastore terraform - not authorized
i created unity catalog using terraform on AWS, and able to create manualy a meta store with same user.when trying to create metsastore from terraform, i get unauthorized error:Error: cannot create metastore: Unauthorized│ │ with module.unity_catalo...
- 3093 Views
- 2 replies
- 4 kudos
- 16171 Views
- 10 replies
- 6 kudos
Resolved! GC (Metadata GC Threshold) issue
Hi All,I am facing the GC metadata issue while performing distributed computing on Spark. 2022-01-13T22:02:28.467+0000: [GC (Metadata GC Threshold) [PSYoungGen: 458969K->18934K(594944K)] 458969K->18958K(1954816K), 0.0144028 secs] [Times: user=0.05 sy...
- 16171 Views
- 10 replies
- 6 kudos
- 6 kudos
Hi @Chandan Angadi​ Hope you are doing well now.Thanks for getting back to us and sending in your solution. Would you like to mark an answer as best?Thanks!
- 6 kudos