cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Gilg
by Contributor II
  • 1954 Views
  • 3 replies
  • 0 kudos

Delta Sharing within the same region

Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...

  • 1954 Views
  • 3 replies
  • 0 kudos
Latest Reply
NikunjKakadiya
New Contributor II
  • 0 kudos

Do we have any updates on this in terms of how we can share the data between different workspaces part of the same metastore?

  • 0 kudos
2 More Replies
js54123875
by New Contributor III
  • 9110 Views
  • 4 replies
  • 0 kudos

Delete and Recreate Metastore in Same Region

We have an existing metastore in a region. We would like to delete it (Create a Unity Catalog metastore - Azure Databricks | Microsoft Learn) and create a new metastore in that same region. Are there any issues that we should be aware of with creatin...

  • 9110 Views
  • 4 replies
  • 0 kudos
Latest Reply
BapsDBC
New Contributor III
  • 0 kudos

I have exactly the same query.But before that, is it at all a good practice to delete the default metastore ? I am asking this because Databricks creates a lot of things on the Azure side like a storage account, access connector, managed identity, li...

  • 0 kudos
3 More Replies
Marra
by New Contributor III
  • 19430 Views
  • 11 replies
  • 17 kudos

Resolved! Unity Catalog - multiple metastore in same region

Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...

  • 19430 Views
  • 11 replies
  • 17 kudos
Latest Reply
AdamMcGuinness
New Contributor III
  • 17 kudos

I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.

  • 17 kudos
10 More Replies
Barney
by New Contributor II
  • 7194 Views
  • 6 replies
  • 1 kudos

How to Import an old Unity Catalog Metastore to a new Unity Catalog Metastore?

Hi All,I have created a new Unity Catalog (UC) metastore (new metastore ID) in west europe and now i want to import alle catalog/schema/tables form the old metastore (west europe) container to the new UC metastore.Note: coping all tables form the old...

  • 7194 Views
  • 6 replies
  • 1 kudos
Latest Reply
drii_cavalcanti
New Contributor III
  • 1 kudos

Hi Barney,Just wondering if you got this issue solved.Thank you so much,Adriana Cavalcanti

  • 1 kudos
5 More Replies
Alex006
by Contributor
  • 15813 Views
  • 9 replies
  • 10 kudos

Resolved! Metastore creation - Azure Databricks - Access validation failed

Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...

Access validation failed when trying to create a metastore Role assignment to azure databricks connector in the storage account
  • 15813 Views
  • 9 replies
  • 10 kudos
Latest Reply
abarber
New Contributor II
  • 10 kudos

I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.

  • 10 kudos
8 More Replies
Sreeanth
by New Contributor II
  • 5789 Views
  • 2 replies
  • 1 kudos

Metastore creation error

This path doesn't exist or we couldn't access it with the credential provided. Metastores require a directory path.Hello Team, Trying to create metasotre, followed the databricks community document encountering above error. Please help me in resolvin...

  • 5789 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

To resolve the error, you can follow these steps: Verify the directory path: Ensure that the directory path you provided for the Metastore exists and is accessible. Double-check the path and make sure it is correct. Check the credentials: Ensure th...

  • 1 kudos
1 More Replies
nikhilkumawat
by New Contributor III
  • 2526 Views
  • 2 replies
  • 1 kudos

Resolved! Not able to get json response for "/api/2.0/accounts/{account_id}/metastores" endpoint.

Hi ,I am trying to get list of all the metastores associated with an accountId. For this I am using the below REST API to get data:accountId = json.loads(dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson())["tags"]["accountId"]...

metastore_response
  • 2526 Views
  • 2 replies
  • 1 kudos
Latest Reply
ruben1
New Contributor III
  • 1 kudos

Apparently, it is working if I add the header `X-Databricks-Account-Console-API-Version` with value `2.0` to the call

  • 1 kudos
1 More Replies
Barney
by New Contributor II
  • 2449 Views
  • 2 replies
  • 0 kudos

Metastore down events in Databricks Workspace

Hi all,I see a number of metastore down events in databricks workspace: do any one know what's the reason why this happens?Thanks,Barney

  • 2449 Views
  • 2 replies
  • 0 kudos
Latest Reply
pvignesh92
Honored Contributor
  • 0 kudos

Hi @Ron Barneveld​ Could you kindly help with more details? Is this is a production metastore that you are mentioning or any metastore created by you for test environment. Also where it is hosted?

  • 0 kudos
1 More Replies
Elon
by New Contributor III
  • 8356 Views
  • 1 replies
  • 5 kudos

Create Metastore. Missing permissions: The associated credential does not grant permission to perform all necessary operations.

Cloud: AWSRegion: eu-west-1S3 location: s3://databricks-dev-bucketIAM role ARN: arn:aws:iam::18XXXXXXXX29:role/databricks-s3-metastoreGuide followed: ref: https://docs.databricks.com/data-governance/unity-catalog/get-started.html#cloud-tenant-setup-a...

image.png Polic simulator
  • 8356 Views
  • 1 replies
  • 5 kudos
Latest Reply
Elon
New Contributor III
  • 5 kudos

Bump. @Yeshaswini P V​ @Gokul Kumar P​

  • 5 kudos
Mado
by Valued Contributor II
  • 5147 Views
  • 4 replies
  • 1 kudos

Resolved! How to create a new metastore?

Hi,I want to configure Unity Catalog and one step is creating a metastore in the region where I create databricks workspace (I am on Azure). I created a workspace with a premium pricing tier and I am the admin. Following the documentation, I should g...

image.png image
  • 5147 Views
  • 4 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Mohammad Saber​ Glad to hear that!Please mark the answer as best. It will be highly grateful.Thanks

  • 1 kudos
3 More Replies
Gustavo_Az
by Contributor
  • 7331 Views
  • 4 replies
  • 0 kudos

Resolved! Cant make Unity Catalog work on Azure

HelloI have created the metastore, linked it to the worskpace, my account is admin in Azure and Databricks, followed these instructions:link1link2link3But when I try to create a table (granting privileges to use catalog, create schemas and create tab...

error unity catalog error overlaps with managed storage
  • 7331 Views
  • 4 replies
  • 0 kudos
Latest Reply
Gustavo_Az
Contributor
  • 0 kudos

I finally made it work.It seems that although after configuring the metastore to work with a manged identity, the metastore must be upgraded with this guide.

  • 0 kudos
3 More Replies
SanjayJanardhan
by New Contributor III
  • 3200 Views
  • 4 replies
  • 9 kudos

Unity Catalog - Metastore is it at account or workspace

I was trying to understand Unity Catalog, if metastore is at the account level or the each workspace in the account will have there own metastore? My understanding is the metastore cant be shared between two workspace.

  • 3200 Views
  • 4 replies
  • 9 kudos
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 9 kudos

@Sanjay Janardhan​ , no i have done this, you can share it in multiple workspaces

  • 9 kudos
3 More Replies
LukaszJ
by Contributor III
  • 18138 Views
  • 12 replies
  • 4 kudos

Problems with Unity Catalog

Hello.I am using Azure Databricks since a few months and I want to add a Unity Catalog.Unfortunately, I have some problems:1. I am not able to create a Unity Catalog Cluster with settings:- Policy: Unrestricted- Multi Node with Single user access mod...

image
  • 18138 Views
  • 12 replies
  • 4 kudos
Latest Reply
Addi1
New Contributor II
  • 4 kudos

I'm facing the same issues as other customers listed above. I do not have the "Create Metastore" button available.

  • 4 kudos
11 More Replies
amitca71
by Contributor II
  • 3721 Views
  • 2 replies
  • 4 kudos

Resolved! unity catalog databricks_metastore terraform - not authorized

i created unity catalog using terraform on AWS, and able to create manualy a meta store with same user.when trying to create metsastore from terraform, i get unauthorized error:Error: cannot create metastore: Unauthorized│ â”‚  with module.unity_catalo...

  • 3721 Views
  • 2 replies
  • 4 kudos
Latest Reply
amitca71
Contributor II
  • 4 kudos

thanks

  • 4 kudos
1 More Replies
chandan_a_v
by Valued Contributor
  • 21538 Views
  • 9 replies
  • 6 kudos

Resolved! GC (Metadata GC Threshold) issue

Hi All,I am facing the GC metadata issue while performing distributed computing on Spark. 2022-01-13T22:02:28.467+0000: [GC (Metadata GC Threshold) [PSYoungGen: 458969K->18934K(594944K)] 458969K->18958K(1954816K), 0.0144028 secs] [Times: user=0.05 sy...

  • 21538 Views
  • 9 replies
  • 6 kudos
Latest Reply
Anonymous
Not applicable
  • 6 kudos

Hi @Chandan Angadi​ Hope you are doing well now.Thanks for getting back to us and sending in your solution. Would you like to mark an answer as best?Thanks!

  • 6 kudos
8 More Replies
Labels