cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

TanushM
by New Contributor
  • 3031 Views
  • 3 replies
  • 0 kudos

Unity Catalog- Informatica Cloud Data Governance & Catalog Integration

We are attempting to create a comprehensive Data Governance solution using Unity Catalog & INFA CDGC tool. The objective is to onboard the business assets on the Informatica DG platform and use the unity catalog to trace technical assets and lineage ...

  • 3031 Views
  • 3 replies
  • 0 kudos
Latest Reply
Starry
New Contributor II
  • 0 kudos

Yes, Informatica now has native integration to Unity Catalog with its cloud data catalogue and governance service. You can scan Unity catalog Metadata and propagate this in CDGC and apply policies, business terms, overlay data quality scores, display...

  • 0 kudos
2 More Replies
fuselessmatt
by Contributor
  • 3637 Views
  • 2 replies
  • 1 kudos

Resolved! Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform?

We have been successfully managing access for our unity catalogs using the databricks_grant resources in Terraform. Now we want to enable the Rudderstack integration for Databricks, but that does not support unity catalog and instead put files inside...

  • 3637 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

@Mattias P​ :Unfortunately, it is not currently possible to manage access to the Hive Metastore catalog (or other external metastores) using the databricks_grant resource in Terraform. This is because the databricks_grant resource is specifically des...

  • 1 kudos
1 More Replies
Marra
by New Contributor III
  • 9937 Views
  • 12 replies
  • 18 kudos

Resolved! Unity Catalog - multiple metastore in same region

Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...

  • 9937 Views
  • 12 replies
  • 18 kudos
Latest Reply
AdamMcGuinness
New Contributor III
  • 18 kudos

I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.

  • 18 kudos
11 More Replies
Ismail1
by New Contributor III
  • 3949 Views
  • 4 replies
  • 5 kudos

Resolved! Unity Catalog meta store renaming

Hi guys, new to we have a unity catalog setup already supporting 4 of our workspaces and we would like to rename the metastore. What I would like to confirm is whether or not would I require any configurational or code changes after renaming?

  • 3949 Views
  • 4 replies
  • 5 kudos
Latest Reply
Anonymous
Not applicable
  • 5 kudos

Hi @Syed Ismail​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 5 kudos
3 More Replies
animadurkar
by New Contributor III
  • 5769 Views
  • 6 replies
  • 3 kudos

Resolved! Unable to query Unity Catalog tables from notebooks.

In my workspace, I'm able to see the unity catalogs my team has created. I'm able to see the schemas and even query data in there and create views using the SQL Editor.When I go to write the same sql queries from a notebook using spark.sql or %sql I ...

  • 5769 Views
  • 6 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Ani Madurkar​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...

  • 3 kudos
5 More Replies
DataEngineer92
by New Contributor II
  • 2738 Views
  • 4 replies
  • 2 kudos

Resolved! Databricks-connect 11.3 works with Unity Catalog ?

Databricks-connect 11.3 works for unity catalog enabled cluster or not ? I am trying to utilize the databricks-connect in Azure DevOps pipeline using Microsoft hosted agent. But getting the below error when running the databricks-connect test command...

  • 2738 Views
  • 4 replies
  • 2 kudos
Latest Reply
bastih
New Contributor III
  • 2 kudos

Hi @Rey Jhon​ Sadly, databricks-connect for DBR versions < 13 does not support UC, as outlined in the limitations section: https://docs.databricks.com/dev-tools/databricks-connect-legacy.html#limitations.To use UC, we recommend using DBR version >= 1...

  • 2 kudos
3 More Replies
Kayl669
by New Contributor III
  • 1651 Views
  • 5 replies
  • 3 kudos

Advice regarding retaining environment-specific access when applying Unity Catalog to workspaces split by environment

My org is considering a transition from hive metastore to unity catalog. We currently have a workspace for each of dev/uat/production and each of those provide access to their respective blob storage account data. Unity Catalog sits at the account-le...

  • 1651 Views
  • 5 replies
  • 3 kudos
Latest Reply
Kayl669
New Contributor III
  • 3 kudos

I did find this document which indicates that you can set the initial catalog on cluster start:: https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/hive-metastore#differences-from-table-access-control

  • 3 kudos
4 More Replies
agallard
by New Contributor III
  • 3819 Views
  • 6 replies
  • 6 kudos

I can´t used Unity Catalog

Hi, i try to used Unity Catalog in my workspace but i don´t get it!I have followed all the steps in this video and this is my group resource in Azure: After, i change Access control (IAM):Now i have the rol as Administrator and Owner in workspace.But...

1 2 3 4
  • 3819 Views
  • 6 replies
  • 6 kudos
Latest Reply
agallard
New Contributor III
  • 6 kudos

Hi @Kaniz Fatma​ i´m owner to the workspace of Databricks but i can´t used Unity Catalog,I tried install dbdemo about Unity Catalog:%pip install dbdemos   import dbdemos dbdemos.install('uc-03-data-lineage')it created a notebook and cluster, but the ...

  • 6 kudos
5 More Replies
ryan321321
by New Contributor III
  • 10348 Views
  • 9 replies
  • 7 kudos

Unity Catalog-Error Creating Table ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException

I have managed to create my catalog and schema on unity catalog. Added Storage Blob Contributor role to the unity catalog metastore in ADLS for the Access Connector for Azure Databricks.however, when trying to create a table i received this error:Err...

image.png image image
  • 10348 Views
  • 9 replies
  • 7 kudos
Latest Reply
Anonymous
Not applicable
  • 7 kudos

Hi @adam wong​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback wi...

  • 7 kudos
8 More Replies
youssefmrini
by Honored Contributor III
  • 1881 Views
  • 1 replies
  • 1 kudos
  • 1881 Views
  • 1 replies
  • 1 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 1 kudos

Feel free to watch a recording I made showing how to use the sync to upgrade tables from Hive metastore to Unity Catalog https://www.youtube.com/watch?v=HTiwJH9nvr8

  • 1 kudos
lizou
by Contributor II
  • 2224 Views
  • 6 replies
  • 4 kudos

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columns

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columnstable definition exampleCREATE TABLE tyable_name ( UniqueID bigint not null GENERATED ALWAYS AS IDENTITY ,  ID varchar(256))looks like ...

image
  • 2224 Views
  • 6 replies
  • 4 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 4 kudos

@Werner Stinckens​ @Christy Seto​ @Jose Gonzalez​ can you help with that issue? It is a really interesting bug and a nice feature once it will work correctly.

  • 4 kudos
5 More Replies
Guilherme_Jorda
by New Contributor
  • 996 Views
  • 3 replies
  • 2 kudos

Unable to link/assign a unity catalog metastore to a workspace

We are following these instructions to link/assign a unity catalog metastore to a workspace using the UI. When we apply the option to enable the unity metastore in the workspace configuration, after hitting "Update", the option gets disabled. When we...

  • 996 Views
  • 3 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

@Guilherme Jordan​ :If the option to enable the Unity Catalog metastore in the workspace configuration is getting disabled after hitting "Update", it could be a sign of an issue with the workspace or the Unity Catalog metastore.Here are some steps yo...

  • 2 kudos
2 More Replies
venkad
by Contributor
  • 4025 Views
  • 3 replies
  • 3 kudos

dbutils.fs.ls doesn't work on Unity catalog managed location

Hi,dbutils.fs.ls() is a most useful utility to list the files in remote cloud storage. I cannot use this function on top of the location managed by the Unity catalog.I have a managed external location created on `'abfss://xyz@abcd.dfs.core.windows.ne...

  • 4025 Views
  • 3 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Venkadeshwaran K​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...

  • 3 kudos
2 More Replies
munjal_prerna
by New Contributor II
  • 2724 Views
  • 3 replies
  • 3 kudos

Problem in enabling unity catalog

I have databricks premium and I want to enable unity catalog on it, I am not able to do so. I followed the following steps which are attached in the attachments. I am also attaching the screenshot of my cluster configuration. When I run this command:...

  • 2724 Views
  • 3 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Prerna Munjal​ Help us build a vibrant and resourceful community by recognizing and highlighting insightful contributions. Mark the best answers and show your appreciation!Regards

  • 3 kudos
2 More Replies
akashs04
by New Contributor II
  • 1278 Views
  • 5 replies
  • 1 kudos

How to resolve the AnalysisException "DENY is not supported in Unity Catalog"

Hi All,I am trying to manage access to objects created in a Unity Catalog.I want the owner/creator of the object(me) to not have access to the object and only the specified users/groups to be able to select/perform other actions on the objects.But th...

  • 1278 Views
  • 5 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @Akash Sivadas​, It seems there is a syntax error here. Please try the below syntax:-%sql   DENY EXECUTE ON FUNCTION catalogName.schemaName.functionTest TO username@email.com;  

  • 1 kudos
4 More Replies
Labels