If you're catching up on Data + AI Summit 2026, here’s a simple Unity Catalog recap for data governance. Three themes stand out: Control, Context, and Choice. Control: Keep governance consistent as AI moves from access to action. AI governance at Dat...
Hello All,We have recently created a databricks with UC enabled. All the VNET Pairing is completed. Now, while I am trying to create a table [Managed] under a catalog / schema - I am not able to query the table. I am getting below error org.apache.ha...
Hi @dipanjannet , This could be due to the code falling back to the hive metastore, which could be due to a number of reasons, but the first thing that caught my eye was that the table name in your saveAsTable() call isn't fully qualified. Can you ad...
Hi,I have tried to execute Vectorized udfs in SQL editor of Databricks, I am getting the following error[FEATURE_UNAVAILABLE] Pandas UDF is not supported in your environment. To use this feature, please contact Databricks Support. SQLSTATE: 56038Coul...
Hi Avinash, I believe this is not supported on Sql editor yet. However, it is available in DBR rollout 16.3.1. Hope this helps!
According to the docs, we should be able to use SYNC TABLE to 'upgrade' a table from a Hive metastore to Unity Catalog. We are using AWS Glue as our Hive Metastore, but tables created in Glue do not seem to be set up in a format that Databricks likes...
Hi team,The issue arises because Unity Catalog's SYNC command cannot process tables that were created using the Hive SerDe format in the hive_metastore catalog. This means that any attempts to upgrade such tables will fail. You need to convert your H...
Is it possible to update the schema/change the type of individual feature in a feature store?
Hi Henrik, Please check this documentation and let me know if it answers your question -> https://docs.databricks.com/gcp/en/machine-learning/feature-store/uc/feature-tables-uc#update-a-feature-table-in-unity-catalog Thank you!
Hi there,When creating an external table in Unity Catalog using an existing Delta Lake table with a comment on the table itself, the comment isn't imported to the `Comment` key's value in the Unity Catalog table.Could you explain why?
Hi team, Have you tried using SQL command to update the column comment?ALTER TABLE <table_name> ALTER COLUMN <column_name> COMMENT '<comment_text>';I believe this should resolve the issue
Unity Catalog (UC) tracks the metadata and your cloud storage accounts store the your data. This python script will extract the metadata from {catalog}.information_schema into folders in a storage location. Take this and put into a notebook. Make da...
Hi,I am working for a large company that is implementing a Databricks solution. We have multiple domains, each responsible for its own data products, following a data mesh approach.As part of a federated governance model, we need a way to communicate...
If a model is registered in Unity Catalog, then what all APIs and SDKs could be used to build the entire lineage for a model? I'm trying to figure out what all do I query to ensure I don't miss any element of the model lineage.Now a model can have be...
@rashij You're tackling an important challenge in ML governance. Building a comprehensive lineage for models registered in Unity Catalog requires piecing together information from multiple APIs. Let me outline a more complete approach based on your i...
I am trying to set up Unity Catalog in Azure Databricks following this documentation Unity Catalog, but I do not find "Create Metastore" and "Create Metastore" on Databricks.Please help with the same, how can I enable Unity Catalog.
This issue is resolved. Thank you @Camilla Lok​ and @Harun for the suggestions. It works fine after enabling Global administrators in Azure Active Directory .
Dear community, I want to configure the unity catalog with databricks, but the Create MetaStore button does not appear in my Azure Databricks workspace.In the community, I have seen that several users present the same situation ... What is the reason...
If I am the owner of the Azure Subcription and databricks premium is in my resource group that makes me owner on that RG as well as Databricks i am still not able to see Metastore setting for unity catalog .. have someone found a resolution to this. ...
I'm working out a terraform script that creates a job that needs to write files in the volume.When the job runs as me (I have full privileges), it encounters the following error if running with job compute: Permission error: operation not permitted...
I think I found the solution, you need to specify the data_security_mode parameter as SINGLE_USER to grant access to the Unity Catalog
Hi there,Please, I am trying to understand if Databricks is able to support master data management capabilities. Particularly, focusing on the following ones:- Integrate and link different data systems: Connect various systems and make sure the data ...
We at Frisco Analytics are a built on partner for Databricks and built and MDM application that is native to Databricks. https://www.lakefusion.ai/ Please contact us at contact@friscoanalytics.com .Thank you!Haritha
Hi all,I'm deploying Unity Catalog into a large enterprise with quite strict controls. I want to give my users some autonomy over creating tables from upstream datasets they have select access on, but also restrict these controls. I've been through a...
@ajbush did you workout your requirements in a way you wanted? appreciate if you can share insights here.
I am trying to connect to Unity catalog meta store tables using Presto Based on the presto documentation I need to use the below configuration to connect to delta tables in the unity catalog https://prestodb.io/docs/current/connector/hive.htmlSo from...
Hello @December , You should contact your account team if you need more info on this feature which is not GA for the time being. Another option would be to use Iceberg REST interface: https://medium.com/@flyws1993/oss-trino-to-read-tables-from-databr...
How can I get the unity catalog code base?
https://github.com/unitycatalog/unitycatalogThis is the OSS version of course. The databricks version is not available afaik.
