- 7259 Views
- 4 replies
- 0 kudos
Unity Catalog- Informatica Cloud Data Governance & Catalog Integration
We are attempting to create a comprehensive Data Governance solution using Unity Catalog & INFA CDGC tool. The objective is to onboard the business assets on the Informatica DG platform and use the unity catalog to trace technical assets and lineage ...
- 7259 Views
- 4 replies
- 0 kudos
- 0 kudos
Yes, Informatica now has native integration to Unity Catalog with its cloud data catalogue and governance service. You can scan Unity catalog Metadata and propagate this in CDGC and apply policies, business terms, overlay data quality scores, display...
- 0 kudos
- 248 Views
- 0 replies
- 3 kudos
Backing up your unity catalog metadata
Unity Catalog (UC) tracks the metadata and your cloud storage accounts store the your data. This python script will extract the metadata from {catalog}.information_schema into folders in a storage location. Take this and put into a notebook. Make da...
- 248 Views
- 0 replies
- 3 kudos
- 18075 Views
- 9 replies
- 10 kudos
Backup Unity Catalog and managed tables
Hi All, Can anyone point me to either documentation or personally tried and tested method of backing up (and restoring) Unity Catalog and its associated managed tables? We're running on Azure and using ADLS Gen2.Regards,Ashley
- 18075 Views
- 9 replies
- 10 kudos
- 10 kudos
Unity Catalog (UC) tracks the metadata and your cloud storage accounts store the your data. This python script will extract the metadata from {catalog}.information_schema into folders in a storage location. Take this and put into a notebook.Make data...
- 10 kudos
- 2007 Views
- 3 replies
- 0 kudos
Implementing Federated Governance in Databricks Unity Catalog
Hi,I am working for a large company that is implementing a Databricks solution. We have multiple domains, each responsible for its own data products, following a data mesh approach.As part of a federated governance model, we need a way to communicate...
- 2007 Views
- 3 replies
- 0 kudos
- 683 Views
- 4 replies
- 0 kudos
How to build model lineage programmatically in a cohesive manner?
If a model is registered in Unity Catalog, then what all APIs and SDKs could be used to build the entire lineage for a model? I'm trying to figure out what all do I query to ensure I don't miss any element of the model lineage.Now a model can have be...
- 683 Views
- 4 replies
- 0 kudos
- 0 kudos
@rashij You're tackling an important challenge in ML governance. Building a comprehensive lineage for models registered in Unity Catalog requires piecing together information from multiple APIs. Let me outline a more complete approach based on your i...
- 0 kudos
- 6551 Views
- 7 replies
- 9 kudos
I do not find "Create Catalog "and "Create Metastore" on Azure Databricks.
I am trying to set up Unity Catalog in Azure Databricks following this documentation Unity Catalog, but I do not find "Create Metastore" and "Create Metastore" on Databricks.Please help with the same, how can I enable Unity Catalog.
- 6551 Views
- 7 replies
- 9 kudos
- 9 kudos
This issue is resolved. Thank you @Camilla Lok​ and @Harun for the suggestions. It works fine after enabling Global administrators in Azure Active Directory .
- 9 kudos
- 13249 Views
- 2 replies
- 1 kudos
Unity Catalog permissions approach for strict controls when creating tables
Hi all,I'm deploying Unity Catalog into a large enterprise with quite strict controls. I want to give my users some autonomy over creating tables from upstream datasets they have select access on, but also restrict these controls. I've been through a...
- 13249 Views
- 2 replies
- 1 kudos
- 1 kudos
@ajbush did you workout your requirements in a way you wanted? appreciate if you can share insights here.
- 1 kudos
- 30079 Views
- 17 replies
- 3 kudos
Unity Catalog - Error getting sample data in data explorer
I get an error message saying I Error getting sample data, when I try to view sample data from a table in a schema I created in a Unity Catalog. I dropped the schema and table and got a collague to recreate and still the same message. We are both Uni...
- 30079 Views
- 17 replies
- 3 kudos
- 3 kudos
Check your table level ACLs, refresh your session, and verify role inheritance. Even if permissions look the same, there might be a small difference causing the issue. Try comparing your access settings with your colleague’s to spot any discrepancies...
- 3 kudos
- 21811 Views
- 15 replies
- 4 kudos
In Azure Databricks Delta Lake not able to see unity catalog databases or tables in the drop down.
I have created an Azure data factory pipeline with a copy data function to copy data from adls path to a delta table .In the delta table drop downs i am able to see only the hive metastore database and tables only but the unity catalog tables are not...
- 21811 Views
- 15 replies
- 4 kudos
- 4 kudos
Any further updates on this? I also have the same problem. I tried above solutions, but no luck. By default, it shows only default and it's tables and I can preview those tables. If I enter the <catalog>.<schema> manually, it populates all the tables...
- 4 kudos
- 10199 Views
- 5 replies
- 5 kudos
Creating a persistent view that references both Unity Catalog and Hive Metastore objects is not supported in Unity Catalog
I tried to create a view in hive_metastore.default which would access a table from a different catalog. Is there any chance to do so?eg.create view myTest as select * from someCatalog.someSchema.someTable
- 10199 Views
- 5 replies
- 5 kudos
- 5 kudos
Hi, so I don't know if you still have this problem (seeing as this post is almost 3 years old now haha) but I came across this when I was trying to solve an issue. What worked for me was creating the unity catalog table in the hive_metastore using an...
- 5 kudos
- 1156 Views
- 2 replies
- 0 kudos
Is there a way for users to modify column/table comments without owning the object?
From my understanding, a user needs to own the object in order to alter the comments of columns/tables. A user would also need ALTER TABLE permissions in order to make the change. Is there a way to permit a user to change comments without giving them...
- 1156 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @mrosman,As far as I understand, you can only provision SELECT / MODIFY / APPLY TAG to a table. And there is no specific privilege as of now in UC where you can assign a permission to alter the table / column comments. If the user have SELECT priv...
- 0 kudos
- 921 Views
- 0 replies
- 0 kudos
Unlock Intelligent Automation with AI Agents & Databricks
Are manual processes slowing down your business? Struggling with data silos and security concerns while scaling AI? Without the right automation and governance, AI adoption can be challenging.Join us for an exclusive live webinar on March 28th, 2025,...
- 921 Views
- 0 replies
- 0 kudos
- 2385 Views
- 2 replies
- 2 kudos
Resolved! Is it possible to update managed location for a Schema in Unity Catalog after the migration
In Unity Catalog, we can specify the managed location for a schema while creation.However, say if we migrate the tables and schemas from Hive metastore to UC without specifying managed location while creating the schema in UC.Is there a way to update...
- 2385 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @bhanu_dp In Databricks Unity Catalog, once a schema is created without specifying a managed location, you cannot directly alter the schema to set or change its managed location. The managed location is typically set at the time of schema creation...
- 2 kudos
- 2524 Views
- 2 replies
- 0 kudos
Resolved! Naming Convention for UC Data recommendations in Catalog tree
Hi everyone, We're considering bringing a section called "For You" in the catalog tree view into the Catalog Explorer tab. Right now this section surfaces active tables and favorited UC objects in authoring surfaces (SQL Editor, Notebooks, and Dashbo...
- 2524 Views
- 2 replies
- 0 kudos
- 0 kudos
That makes a lot of sense! We're considering revamping it to not have the For You pills and to put the favorites up at the top
- 0 kudos
- 1738 Views
- 1 replies
- 1 kudos
Deprecation of DBFS?
I am using Azure Databricks DBFS. I have stored some python scripts, notebooks in folders in DBFS root and have mounted ADLS Gen2 to DBFS. Currently I do not have Unity Catalog enabled and this was setup 3-4 years ago. I came across this article http...
- 1738 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @humayun! DBFS mounts and root storage are deprecated, as they are not secure with the Unity Catalog and pose security risks. While there’s no official end-of-life date, Databricks discourages using mounts and root storage. Existing setups will...
- 1 kudos