If you're catching up on Data + AI Summit 2026, here’s a simple Unity Catalog recap for data governance. Three themes stand out: Control, Context, and Choice. Control: Keep governance consistent as AI moves from access to action. AI governance at Dat...
I just got through reading the great technical blog post from @SergeRielau about session variableshttps://community.databricks.com/t5/technical-blog/sql-session-variables-stash-your-state-and-use-it-too/bc-p/72453#M193Super useful facility and well ...
Hi,I am trying to obtain SOC compliance documents for my company. Despite following the instructions of the AI assistant, I can't find anywhere to submit a support ticket to get these documents. Has anyone had experience with this issue in the past w...
You can contact your Databricks account executive (sales representative), they should be able to get you the copy of SOC compliance reports.
Hi I was wondering how you would apply tags to tables, columns etc in unity catalog through code?One use case i want to have a look at is by automatically applying PI classification against certain tables and columns that contain certain words.Is thi...
Using sql:https://docs.databricks.com/en/data-governance/unity-catalog/tags.html#manage-tags-using-sql-commandsI am not aware of a python/scala counterpart (but using spark.sql() that is no issue).
We have observed that the latest UCX version includes some jobs for migrating tables. Could you please confirm if these jobs will handle the actual migration of tables to Unity Catalog automatically? Or do we need to write our own scripts to complete...
What is the vision of uc and purview , on government
There's some changes to Purview coming out that enable users to create Data Products in Purview as the start of a Data Fabric which is realized in Databricks. ER/Studio allows you to design structures with well-formed data models of your Databricks L...
We are facing an issue related to the Data type mismatch when performing the federation queries (link).Basic need is to perform union on these both tables from federated(system tables) and system tables (target/current workspace).Problem: Struct and...
System table data is available at the account level. If you are trying LH Federation for querying system tables isn't that already available in the source workspace? https://docs.databricks.com/en/admin/system-tables/index.html#what-are-system-table...
When creating a Unity catalog using a service principal token, the created catalog isn't visible or accessible to other users (even admins) via GUI nor CLI.It seems that only when I change the catalog's ownership to some other user it is visible.Why ...
Right after the creation of the catalog, add a new grant statement. Check here please.
We are trying to build the history snapshot for data that we are ingested in the delta tables. We are exploring different option like delta history, change data feed and dbt snapshot.This Question is particularly about the change data feed. So I want...
Hello @manjeettanwar10 , The Delta History API allows you to view the logs of all SQL statements executed on your table, including UPDATE, DELETE, and INSERT commands. When used in conjunction with Delta's Time Travel features, it's possible to retri...
Hi!Recently we encountered a problem with how Databricks handles secrets that does not meet our compliance.We need total isolation of users credentials but seems like the admin role in databricks totally breaks that since a person with that role can ...
Hi @ChechuIGZ - The value of the secret is redacted. https://docs.databricks.com/en/security/secrets/redaction.html#secret-redaction. Also remember the following -
Hi all,I need to mask columns in a table for certain users.What is the best way to go about this in Databricks? My workspace is unity catalog enabled.Thanks,Sean
In UC you can use column masking. See here - https://docs.databricks.com/en/data-governance/unity-catalog/row-and-column-filters.html#what-are-column-masks
I am ingesting job-cluster failure notifications that we send to OpsGenie into a delta table to automate the creation and tracking of Jira tickets. The alert notification includes the job run url, which we use to quickly respond to job failures. Ho...
I tracked this issue down to running the notebook on a shared Unity-enabled cluster. When scheduling the notebook to run on a job cluster with single user mode, this issue does not occur.
I have encountered with the Databricks CLI command databricks metastores list. As per our account setup, we have three metastores configured. However, when I run the command, it only returns information for one metastore instead of listing all three....
Hi @jv_v , Good Day! The command you are running gives you Metastore details attached to your workspace. If you are looking to list out all the metastore present at the Account console, you can try running this below CLI command: ------------------...
SpoilerWe have a UC enabled on Databricks where we have two Metastores,Metastore in West Europe regionMetastore in North America regionAnd Databricks workspace.Workspace in West Europe regionAnd we want to have a single Databricks workspace for both ...
Hi, Cross region metastore and workspace (WS) is not possible. It is important to understand the use case and why you have certain data in a region where you do not have a compute (WS) or do not need a compute. Ideally have each region has their own ...
Hello community !Here's my problem : I had a workspace with Unity Catalog enabled, and a catalog stored on an external location (Azure storage account). All my schemas and tables were storage on this storage. However we recently deleted the metastore...
Hi, Looks like you are creating the catalog at the container level. Are there any other UC objects created pointing to that? Is the external location created at the container level? Can you please have a look at this and see if there is overlapping? ...
Hi All,My client has a table with user names and the authorized territory name the user has access to e.g EMEA, APAC etc. The users can also move to a different territory over time and the same will be updated in the user table table. I have multiple...
Hi, Can you please have a look at this example please? https://docs.databricks.com/en/data-governance/unity-catalog/row-and-column-filters.html#mapping-table-examples If you create account groups for each region and then use IS_ACCOUNT_GROUP_MEMBER t...
