cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

212455
by New Contributor
  • 1332 Views
  • 2 replies
  • 0 kudos

Resolved! List Service Principal OBO Tokens

I am trying to list OBO tokens that have been created for service principals. I tried using the Token Management API 2.0 (https://docs.databricks.com/dev-tools/api/latest/token-management.html#operation/get-tokens) to list workspace tokens, but it on...

  • 1332 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Nick Tran​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...

  • 0 kudos
1 More Replies
js54123875
by New Contributor III
  • 4508 Views
  • 2 replies
  • 0 kudos

Delete and Recreate Metastore in Same Region

We have an existing metastore in a region. We would like to delete it (Create a Unity Catalog metastore - Azure Databricks | Microsoft Learn) and create a new metastore in that same region. Are there any issues that we should be aware of with creatin...

  • 4508 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Jennette Shepard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...

  • 0 kudos
1 More Replies
agallard
by New Contributor III
  • 5699 Views
  • 6 replies
  • 6 kudos

I can´t used Unity Catalog

Hi, i try to used Unity Catalog in my workspace but i don´t get it!I have followed all the steps in this video and this is my group resource in Azure: After, i change Access control (IAM):Now i have the rol as Administrator and Owner in workspace.But...

1 2 3 4
  • 5699 Views
  • 6 replies
  • 6 kudos
Latest Reply
agallard
New Contributor III
  • 6 kudos

Hi @Kaniz Fatma​ i´m owner to the workspace of Databricks but i can´t used Unity Catalog,I tried install dbdemo about Unity Catalog:%pip install dbdemos   import dbdemos dbdemos.install('uc-03-data-lineage')it created a notebook and cluster, but the ...

  • 6 kudos
5 More Replies
RC
by Contributor
  • 2072 Views
  • 2 replies
  • 0 kudos

Unity catalog

Hi Team, Where is the unity catalog placed? I know that it's attached to workspace. Is it some kind of VM? Where is it hosted?I'm able to access Unity catalog even though the clusters are down.BR,Rajath

  • 2072 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Rajath C​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your...

  • 0 kudos
1 More Replies
isaac_gritz
by Valued Contributor II
  • 4635 Views
  • 5 replies
  • 10 kudos

Data Access Control in Databricks

Best Practices for Securing Access to Data in DatabricksUnity Catalog is the unified governance solution for Data & AI assets in Databricks and greatly simplifies and centralized data access control. This guide includes best practices for both the st...

  • 4635 Views
  • 5 replies
  • 10 kudos
Latest Reply
isaac_gritz
Valued Contributor II
  • 10 kudos

Let us know if this walkthrough helped you set up data access control and let us know how your journey to leveraging Unity Catalog is going!

  • 10 kudos
4 More Replies
AlexDavies
by Contributor
  • 3224 Views
  • 1 replies
  • 3 kudos

How to segregate dev/staging/prod data and resources with unity catalog

We are planning on migrating to unity catalog but are unable to determine how we can segregate dev, staging and production data from each otherOur plan was to separate catalogs by SLDC Environment scopes (as per description and diagram at https://doc...

  • 3224 Views
  • 1 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

@Alex Davies​ :Unity Catalog does not currently support separating data by workspace or Azure subscription. As you noted, data from all catalogs within a region can be accessed by any workspace within that region, and it is up to user permissions to ...

  • 3 kudos
ryan321321
by New Contributor III
  • 12482 Views
  • 9 replies
  • 7 kudos

Unity Catalog-Error Creating Table ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException

I have managed to create my catalog and schema on unity catalog. Added Storage Blob Contributor role to the unity catalog metastore in ADLS for the Access Connector for Azure Databricks.however, when trying to create a table i received this error:Err...

image.png image image
  • 12482 Views
  • 9 replies
  • 7 kudos
Latest Reply
Anonymous
Not applicable
  • 7 kudos

Hi @adam wong​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback wi...

  • 7 kudos
8 More Replies
JohnUrban
by New Contributor III
  • 2127 Views
  • 4 replies
  • 4 kudos

Advanced Search on Tables getting error

I click on the Search box on the top bar of the databricks workspace and select "Open advanced search". A dialog pops up with the Tables tab selected and an error below that says: "An error occurred while fetching search results. Please try again lat...

  • 2127 Views
  • 4 replies
  • 4 kudos
Latest Reply
Anonymous
Not applicable
  • 4 kudos

Hi @John Urban​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we...

  • 4 kudos
3 More Replies
FRG96
by New Contributor III
  • 2930 Views
  • 4 replies
  • 1 kudos

"Create external Hive function is not supported in Unity Catalog" when registering Hive UDFs

I have enabled Unity Catalog in my AWS Databricks workspace, switching from the standard Hive Metastore. I have a few custom Hive UDFs in a JAR file that I have copied to /databricks/jars/ folder through init script. I want to be able to register tho...

Hive Permanent Function Error
  • 2930 Views
  • 4 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Franklin George​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...

  • 1 kudos
3 More Replies
alexlod
by New Contributor III
  • 5107 Views
  • 5 replies
  • 0 kudos

Resolved! Unclear validation error message when adding a Unity Catalog metastore in Azure

I'm using Azure Databricks.I've been following this guide to create a Unity Catalog metastore using a managed identity.When I create the catalog and the validation step kicks off, I get this screen: What does this mean?If I click "Force create" and t...

Screenshot 2023-02-07 at 1.06.40 PM
  • 5107 Views
  • 5 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Alex Loddengaard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...

  • 0 kudos
4 More Replies
Guilherme
by New Contributor
  • 1214 Views
  • 2 replies
  • 0 kudos

How this is possible? access error in storage, after selecting data from an delta IN THE STORAGE

Hi people, i`m using databricks Runtime 11.2 - Clusters Standard_F4 with Unity Catalog enabled and the service principals working,I literally perform an select in two delta tables that is in the storage X, the display() works, if i try to write an ne...

  • 1214 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Guilherme Cesar​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...

  • 0 kudos
1 More Replies
iwan_aucamp
by New Contributor III
  • 1988 Views
  • 3 replies
  • 0 kudos

API to get all metastores on the account

The Unity Catalog API 2.1 only supports retrieving the unity catalogs associated with individual workspaces> The listMetastores endpoint does not list all Metstores that exist in the customer account. Instead it restricts the list by what the Workspa...

  • 1988 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Iwan Aucamp​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so w...

  • 0 kudos
2 More Replies
Ajay-Pandey
by Esteemed Contributor III
  • 6232 Views
  • 9 replies
  • 4 kudos

Resolved! Step by step process to create Unity Catalog in Azure Databricks

Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.

  • 6232 Views
  • 9 replies
  • 4 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 4 kudos

I recorded a video showing how to setup Unity Catalog Step by step https://www.youtube.com/watch?v=M2Et5aBj2aw

  • 4 kudos
8 More Replies
youssefmrini
by Honored Contributor III
  • 4918 Views
  • 1 replies
  • 1 kudos
  • 4918 Views
  • 1 replies
  • 1 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 1 kudos

Feel free to watch a recording I made showing how to use the sync to upgrade tables from Hive metastore to Unity Catalog https://www.youtube.com/watch?v=HTiwJH9nvr8

  • 1 kudos
lizou
by Contributor II
  • 2822 Views
  • 6 replies
  • 4 kudos

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columns

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columnstable definition exampleCREATE TABLE tyable_name ( UniqueID bigint not null GENERATED ALWAYS AS IDENTITY ,  ID varchar(256))looks like ...

image
  • 2822 Views
  • 6 replies
  • 4 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 4 kudos

@Werner Stinckens​ @Christy Seto​ @Jose Gonzalez​ can you help with that issue? It is a really interesting bug and a nice feature once it will work correctly.

  • 4 kudos
5 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels