cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

agallard2
by New Contributor III
  • 9451 Views
  • 6 replies
  • 6 kudos

I can´t used Unity Catalog

Hi, i try to used Unity Catalog in my workspace but i don´t get it!I have followed all the steps in this video and this is my group resource in Azure: After, i change Access control (IAM):Now i have the rol as Administrator and Owner in workspace.But...

1 2 3 4
  • 9451 Views
  • 6 replies
  • 6 kudos
Latest Reply
YounsP
New Contributor
  • 6 kudos

Hi Everyone,I’m facing the same issue with Azure Databricks and was hoping someone could help.When I create an Azure Databricks workspace using the Azure subscription provided by my company, the workspace automatically attaches to the company’s Activ...

  • 6 kudos
5 More Replies
animadurkar
by New Contributor III
  • 11982 Views
  • 7 replies
  • 3 kudos

Resolved! Unable to query Unity Catalog tables from notebooks.

In my workspace, I'm able to see the unity catalogs my team has created. I'm able to see the schemas and even query data in there and create views using the SQL Editor.When I go to write the same sql queries from a notebook using spark.sql or %sql I ...

  • 11982 Views
  • 7 replies
  • 3 kudos
Latest Reply
KIRKQUINBAR
New Contributor II
  • 3 kudos

i know this is an old topic, but i have the same issue with querying data using the sql editor and a sql warehouse. my sql warehouse does have unity catalog enabled. not sure why it wouldnt be working.

  • 3 kudos
6 More Replies
Marra
by New Contributor III
  • 19261 Views
  • 11 replies
  • 17 kudos

Resolved! Unity Catalog - multiple metastore in same region

Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...

  • 19261 Views
  • 11 replies
  • 17 kudos
Latest Reply
AdamMcGuinness
New Contributor III
  • 17 kudos

I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.

  • 17 kudos
10 More Replies
lizou
by Contributor II
  • 9903 Views
  • 7 replies
  • 4 kudos

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columns

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columnstable definition exampleCREATE TABLE tyable_name ( UniqueID bigint not null GENERATED ALWAYS AS IDENTITY ,  ID varchar(256))looks like ...

image
  • 9903 Views
  • 7 replies
  • 4 kudos
Latest Reply
anish2102
New Contributor III
  • 4 kudos

Hello Team,Still i am facing same issue of value zero in  character_maximum_length. Is there any other way we can get character_maximum_length of columns?When we can expect to resolve this bug? 

  • 4 kudos
6 More Replies
TanushM
by New Contributor
  • 6175 Views
  • 3 replies
  • 0 kudos

Unity Catalog- Informatica Cloud Data Governance & Catalog Integration

We are attempting to create a comprehensive Data Governance solution using Unity Catalog & INFA CDGC tool. The objective is to onboard the business assets on the Informatica DG platform and use the unity catalog to trace technical assets and lineage ...

  • 6175 Views
  • 3 replies
  • 0 kudos
Latest Reply
Starry
New Contributor II
  • 0 kudos

Yes, Informatica now has native integration to Unity Catalog with its cloud data catalogue and governance service. You can scan Unity catalog Metadata and propagate this in CDGC and apply policies, business terms, overlay data quality scores, display...

  • 0 kudos
2 More Replies
fuselessmatt
by Contributor
  • 4947 Views
  • 2 replies
  • 1 kudos

Resolved! Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform?

We have been successfully managing access for our unity catalogs using the databricks_grant resources in Terraform. Now we want to enable the Rudderstack integration for Databricks, but that does not support unity catalog and instead put files inside...

  • 4947 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

@Mattias P​ :Unfortunately, it is not currently possible to manage access to the Hive Metastore catalog (or other external metastores) using the databricks_grant resource in Terraform. This is because the databricks_grant resource is specifically des...

  • 1 kudos
1 More Replies
Ismail1
by New Contributor III
  • 12826 Views
  • 4 replies
  • 5 kudos

Resolved! Unity Catalog meta store renaming

Hi guys, new to we have a unity catalog setup already supporting 4 of our workspaces and we would like to rename the metastore. What I would like to confirm is whether or not would I require any configurational or code changes after renaming?

  • 12826 Views
  • 4 replies
  • 5 kudos
Latest Reply
Anonymous
Not applicable
  • 5 kudos

Hi @Syed Ismail​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 5 kudos
3 More Replies
DataEngineer92
by New Contributor II
  • 5150 Views
  • 4 replies
  • 2 kudos

Resolved! Databricks-connect 11.3 works with Unity Catalog ?

Databricks-connect 11.3 works for unity catalog enabled cluster or not ? I am trying to utilize the databricks-connect in Azure DevOps pipeline using Microsoft hosted agent. But getting the below error when running the databricks-connect test command...

  • 5150 Views
  • 4 replies
  • 2 kudos
Latest Reply
bastih
Databricks Employee
  • 2 kudos

Hi @Rey Jhon​ Sadly, databricks-connect for DBR versions < 13 does not support UC, as outlined in the limitations section: https://docs.databricks.com/dev-tools/databricks-connect-legacy.html#limitations.To use UC, we recommend using DBR version >= 1...

  • 2 kudos
3 More Replies
Kayl669
by New Contributor III
  • 2945 Views
  • 5 replies
  • 3 kudos

Advice regarding retaining environment-specific access when applying Unity Catalog to workspaces split by environment

My org is considering a transition from hive metastore to unity catalog. We currently have a workspace for each of dev/uat/production and each of those provide access to their respective blob storage account data. Unity Catalog sits at the account-le...

  • 2945 Views
  • 5 replies
  • 3 kudos
Latest Reply
Kayl669
New Contributor III
  • 3 kudos

I did find this document which indicates that you can set the initial catalog on cluster start:: https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/hive-metastore#differences-from-table-access-control

  • 3 kudos
4 More Replies
ryan321321
by New Contributor III
  • 20071 Views
  • 9 replies
  • 8 kudos

Unity Catalog-Error Creating Table ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException

I have managed to create my catalog and schema on unity catalog. Added Storage Blob Contributor role to the unity catalog metastore in ADLS for the Access Connector for Azure Databricks.however, when trying to create a table i received this error:Err...

image.png image image
  • 20071 Views
  • 9 replies
  • 8 kudos
Latest Reply
Anonymous
Not applicable
  • 8 kudos

Hi @adam wong​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback wi...

  • 8 kudos
8 More Replies
youssefmrini
by Databricks Employee
  • 7530 Views
  • 1 replies
  • 1 kudos
  • 7530 Views
  • 1 replies
  • 1 kudos
Latest Reply
youssefmrini
Databricks Employee
  • 1 kudos

Feel free to watch a recording I made showing how to use the sync to upgrade tables from Hive metastore to Unity Catalog https://www.youtube.com/watch?v=HTiwJH9nvr8

  • 1 kudos
Guilherme_Jorda
by New Contributor
  • 2085 Views
  • 3 replies
  • 2 kudos

Unable to link/assign a unity catalog metastore to a workspace

We are following these instructions to link/assign a unity catalog metastore to a workspace using the UI. When we apply the option to enable the unity metastore in the workspace configuration, after hitting "Update", the option gets disabled. When we...

  • 2085 Views
  • 3 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

@Guilherme Jordan​ :If the option to enable the Unity Catalog metastore in the workspace configuration is getting disabled after hitting "Update", it could be a sign of an issue with the workspace or the Unity Catalog metastore.Here are some steps yo...

  • 2 kudos
2 More Replies
venkad
by Contributor
  • 6518 Views
  • 2 replies
  • 3 kudos

dbutils.fs.ls doesn't work on Unity catalog managed location

Hi,dbutils.fs.ls() is a most useful utility to list the files in remote cloud storage. I cannot use this function on top of the location managed by the Unity catalog.I have a managed external location created on `'abfss://xyz@abcd.dfs.core.windows.ne...

  • 6518 Views
  • 2 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Venkadeshwaran K​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...

  • 3 kudos
1 More Replies
munjal_prerna
by New Contributor II
  • 4122 Views
  • 3 replies
  • 3 kudos

Problem in enabling unity catalog

I have databricks premium and I want to enable unity catalog on it, I am not able to do so. I followed the following steps which are attached in the attachments. I am also attaching the screenshot of my cluster configuration. When I run this command:...

  • 4122 Views
  • 3 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Prerna Munjal​ Help us build a vibrant and resourceful community by recognizing and highlighting insightful contributions. Mark the best answers and show your appreciation!Regards

  • 3 kudos
2 More Replies
akashs04
by New Contributor II
  • 2340 Views
  • 3 replies
  • 1 kudos

How to resolve the AnalysisException "DENY is not supported in Unity Catalog"

Hi All,I am trying to manage access to objects created in a Unity Catalog.I want the owner/creator of the object(me) to not have access to the object and only the specified users/groups to be able to select/perform other actions on the objects.But th...

  • 2340 Views
  • 3 replies
  • 1 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 1 kudos

Hi @Akash Sivadas​ ,I think you can do it by data explorer tab.Please refer below blog for the same-Manage Unity Catalog permissions in Data Explorer | Databricks on AWS

  • 1 kudos
2 More Replies
Labels