cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Barney
by New Contributor II
  • 5004 Views
  • 7 replies
  • 1 kudos

How to Import an old Unity Catalog Metastore to a new Unity Catalog Metastore?

Hi All,I have created a new Unity Catalog (UC) metastore (new metastore ID) in west europe and now i want to import alle catalog/schema/tables form the old metastore (west europe) container to the new UC metastore.Note: coping all tables form the old...

  • 5004 Views
  • 7 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @Barney, To import all catalog/schema/tables from the old metastore to the new Unity Catalog (UC) metastore, you can use the Data Explorer upgrade wizard provided by Databricks. Here are the steps: 1. Open the Data Explorer by clicking Data in th...

  • 1 kudos
6 More Replies
Marra
by New Contributor III
  • 9937 Views
  • 12 replies
  • 18 kudos

Resolved! Unity Catalog - multiple metastore in same region

Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...

  • 9937 Views
  • 12 replies
  • 18 kudos
Latest Reply
AdamMcGuinness
New Contributor III
  • 18 kudos

I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.

  • 18 kudos
11 More Replies
Alex006
by Contributor
  • 6196 Views
  • 11 replies
  • 11 kudos

Resolved! Metastore creation - Azure Databricks - Access validation failed

Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...

Access validation failed when trying to create a metastore Role assignment to azure databricks connector in the storage account
  • 6196 Views
  • 11 replies
  • 11 kudos
Latest Reply
abarber
New Contributor II
  • 11 kudos

I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.

  • 11 kudos
10 More Replies
Sreeanth
by New Contributor II
  • 2419 Views
  • 2 replies
  • 1 kudos

Metastore creation error

This path doesn't exist or we couldn't access it with the credential provided. Metastores require a directory path.Hello Team, Trying to create metasotre, followed the databricks community document encountering above error. Please help me in resolvin...

  • 2419 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

To resolve the error, you can follow these steps: Verify the directory path: Ensure that the directory path you provided for the Metastore exists and is accessible. Double-check the path and make sure it is correct. Check the credentials: Ensure th...

  • 1 kudos
1 More Replies
nikhilkumawat
by New Contributor III
  • 1201 Views
  • 2 replies
  • 1 kudos

Resolved! Not able to get json response for "/api/2.0/accounts/{account_id}/metastores" endpoint.

Hi ,I am trying to get list of all the metastores associated with an accountId. For this I am using the below REST API to get data:accountId = json.loads(dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson())["tags"]["accountId"]...

metastore_response
  • 1201 Views
  • 2 replies
  • 1 kudos
Latest Reply
ruben1
New Contributor III
  • 1 kudos

Apparently, it is working if I add the header `X-Databricks-Account-Console-API-Version` with value `2.0` to the call

  • 1 kudos
1 More Replies
js54123875
by New Contributor III
  • 2429 Views
  • 2 replies
  • 0 kudos

Delete and Recreate Metastore in Same Region

We have an existing metastore in a region. We would like to delete it (Create a Unity Catalog metastore - Azure Databricks | Microsoft Learn) and create a new metastore in that same region. Are there any issues that we should be aware of with creatin...

  • 2429 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Jennette Shepard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...

  • 0 kudos
1 More Replies
Barney
by New Contributor II
  • 1181 Views
  • 2 replies
  • 0 kudos

Metastore down events in Databricks Workspace

Hi all,I see a number of metastore down events in databricks workspace: do any one know what's the reason why this happens?Thanks,Barney

  • 1181 Views
  • 2 replies
  • 0 kudos
Latest Reply
pvignesh92
Honored Contributor
  • 0 kudos

Hi @Ron Barneveld​ Could you kindly help with more details? Is this is a production metastore that you are mentioning or any metastore created by you for test environment. Also where it is hosted?

  • 0 kudos
1 More Replies
Elon
by New Contributor III
  • 3007 Views
  • 1 replies
  • 5 kudos

Create Metastore. Missing permissions: The associated credential does not grant permission to perform all necessary operations.

Cloud: AWSRegion: eu-west-1S3 location: s3://databricks-dev-bucketIAM role ARN: arn:aws:iam::18XXXXXXXX29:role/databricks-s3-metastoreGuide followed: ref: https://docs.databricks.com/data-governance/unity-catalog/get-started.html#cloud-tenant-setup-a...

image.png Polic simulator
  • 3007 Views
  • 1 replies
  • 5 kudos
Latest Reply
Elon
New Contributor III
  • 5 kudos

Bump. @Yeshaswini P V​ @Gokul Kumar P​

  • 5 kudos
Mado
by Valued Contributor II
  • 1964 Views
  • 4 replies
  • 1 kudos

Resolved! How to create a new metastore?

Hi,I want to configure Unity Catalog and one step is creating a metastore in the region where I create databricks workspace (I am on Azure). I created a workspace with a premium pricing tier and I am the admin. Following the documentation, I should g...

image.png image
  • 1964 Views
  • 4 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Mohammad Saber​ Glad to hear that!Please mark the answer as best. It will be highly grateful.Thanks

  • 1 kudos
3 More Replies
Gustavo_Az
by Contributor
  • 2944 Views
  • 4 replies
  • 0 kudos

Resolved! Cant make Unity Catalog work on Azure

HelloI have created the metastore, linked it to the worskpace, my account is admin in Azure and Databricks, followed these instructions:link1link2link3But when I try to create a table (granting privileges to use catalog, create schemas and create tab...

error unity catalog error overlaps with managed storage
  • 2944 Views
  • 4 replies
  • 0 kudos
Latest Reply
Gustavo_Az
Contributor
  • 0 kudos

I finally made it work.It seems that although after configuring the metastore to work with a manged identity, the metastore must be upgraded with this guide.

  • 0 kudos
3 More Replies
Gilg
by Contributor II
  • 760 Views
  • 2 replies
  • 0 kudos

Delta Sharing within the same region

Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...

  • 760 Views
  • 2 replies
  • 0 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 0 kudos

If the two Workspaces are under the same metastore you don't need Delta Sharing because they already have access to the same data. Unless you want to do data segregation per workspace. if it's the case it's coming soon at the end of february

  • 0 kudos
1 More Replies
SanjayJanardhan
by New Contributor III
  • 1384 Views
  • 4 replies
  • 9 kudos

Unity Catalog - Metastore is it at account or workspace

I was trying to understand Unity Catalog, if metastore is at the account level or the each workspace in the account will have there own metastore? My understanding is the metastore cant be shared between two workspace.

  • 1384 Views
  • 4 replies
  • 9 kudos
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 9 kudos

@Sanjay Janardhan​ , no i have done this, you can share it in multiple workspaces

  • 9 kudos
3 More Replies
LukaszJ
by Contributor III
  • 7971 Views
  • 13 replies
  • 4 kudos

Problems with Unity Catalog

Hello.I am using Azure Databricks since a few months and I want to add a Unity Catalog.Unfortunately, I have some problems:1. I am not able to create a Unity Catalog Cluster with settings:- Policy: Unrestricted- Multi Node with Single user access mod...

image
  • 7971 Views
  • 13 replies
  • 4 kudos
Latest Reply
Addi1
New Contributor II
  • 4 kudos

I'm facing the same issues as other customers listed above. I do not have the "Create Metastore" button available.

  • 4 kudos
12 More Replies
amitca71
by Contributor II
  • 2318 Views
  • 2 replies
  • 4 kudos

Resolved! unity catalog databricks_metastore terraform - not authorized

i created unity catalog using terraform on AWS, and able to create manualy a meta store with same user.when trying to create metsastore from terraform, i get unauthorized error:Error: cannot create metastore: Unauthorized│ │  with module.unity_catalo...

  • 2318 Views
  • 2 replies
  • 4 kudos
Latest Reply
amitca71
Contributor II
  • 4 kudos

thanks

  • 4 kudos
1 More Replies
chandan_a_v
by Valued Contributor
  • 13382 Views
  • 10 replies
  • 6 kudos

Resolved! GC (Metadata GC Threshold) issue

Hi All,I am facing the GC metadata issue while performing distributed computing on Spark. 2022-01-13T22:02:28.467+0000: [GC (Metadata GC Threshold) [PSYoungGen: 458969K->18934K(594944K)] 458969K->18958K(1954816K), 0.0144028 secs] [Times: user=0.05 sy...

  • 13382 Views
  • 10 replies
  • 6 kudos
Latest Reply
Anonymous
Not applicable
  • 6 kudos

Hi @Chandan Angadi​ Hope you are doing well now.Thanks for getting back to us and sending in your solution. Would you like to mark an answer as best?Thanks!

  • 6 kudos
9 More Replies
Labels