If you're catching up on Data + AI Summit 2026, here’s a simple Unity Catalog recap for data governance. Three themes stand out: Control, Context, and Choice. Control: Keep governance consistent as AI moves from access to action. AI governance at Dat...
We are encountering issue lately around 17 January 2026.We make a Pipeline using DLT and RLS for filtering rows based on user's email. Previously our Row Level Security (RLS) is working fine. Until 3 days ago the dashboard is got into problem said: ...
Hi @ikhwan-maftuh, Based on your description, you are seeing two separate error messages when querying tables that have row filters applied: 1. "Query on table with row filter or column mask not supported on assigned clusters" 2. "INVALID_PARAMETER_V...
Hi,I’m trying to use Databricks Asset Bundles (DAB) to assign Unity Catalog grants to catalogs and schemas that already exist in my workspace.These catalogs and schemas were not originally created through DAB, but I would now like to manage their gra...
Hi @vjussiiih, Let me walk you through this. You are correct that DABs treat schemas and catalogs defined under "resources" as fully managed resources, which means they attempt to create them on first deploy and manage their full lifecycle. This is w...
Hi everyone,I’m currently testing the Data Classification feature in Databricks Unity Catalog.On the dashboard after classification completes, there’s a column called **“User Access.”** Based on the description, it seems to show the number of users w...
Hi @r_w_, Appreciate you sharing the details. the "User Access" column in the data classification results view is one of those features that is not thoroughly covered in the public documentation yet, so I understand the confusion. Here is what I have...
Hi Team,Hope you guys are doing well. Question 1:I am using this Databrick unity catalog rest api endpoint api/2.0/lineage-tracking/table-lineage?table_name=schemaname.catalogname.tablename&include_entity_lineage=true for getting lineage . Is this of...
Thank you so much for response and solution in details.I have one question in Unity Catalog lineage UI showing last 18 months also, but as per official documentation Lineage retains up to last 1 Year. Why this contradicts statement! Also, I am trying...
Is there a current way to limit data exporting. Meaning not allowing users export data from a db objects to csv, excel, or copying results to clipboard. I see that currently exporting/downloading data can be done at workspace level, but I am proposin...
Hi @bigdatabase, As of today, Databricks lets you control downloading notebook results only at the workspace level. As you pointed out, a workspace admin can disable downloading results from the notebook for all users in that workspace. However, ther...
We are attempting to create a comprehensive Data Governance solution using Unity Catalog & INFA CDGC tool. The objective is to onboard the business assets on the Informatica DG platform and use the unity catalog to trace technical assets and lineage ...
@TanushM -- We are also planning to do the same. However we are struggling with the volume of tables inside some schemas in a catalog. Can you suggest some of the best practices you have come across while integrating Unity catalog to CDGC?
It is our understanding that enabling unity catalog means that some metadata (for example usernames) will be sent to the USA for processing/storage. This is unfortunately a deal-breaker for us, and we need the data to reside solely in Europe for comp...
Usernames have always been stored centrally in the US. That's similar to most global services for the IAM Layer. The only thing additional that gets stored in the US as part of UC is the metastore names. you can check this link ( https://azure.micros...
While we evaluate moving our many autoloader configurations to use `cloudFiles.cleanSource` , we're wondering if we can instead just implement a lifecycle policy outside of Databricks that deletes files older than 30 days.Is there a problem with doin...
Hi why are you not planning to move away from directory listing mode to useManagedFileEvents?? execution will be faster and no more scanning of directories everytime. File events use a single Azure Databricks-managed file notification queue for all...
Hi everyone,I'm using the Budget Policy API (https://docs.databricks.com/api/account/budgetpolicy/create) to create Serverless budget policies. I can successfully create and retrieve policies, but I haven’t found any way to manage their permissions —...
Here are some helpful hints/tips/tricks: Programmatic Management of Budget Policy Permissions: Options and Best Practices 1. What is Possible Today? Yes, there is a programmatic way to manage permissions (user and group assignments) for Databricks Bu...
I’m trying to get a full list of Databricks workspace groups and their user memberships. I want to do this in two ways:As a queryable table or view (e.g., for audits, security reviews, app integration)From within a Databricks App (Streamlit-style), u...
@discuss_darende - you could use below code in the notebook.Pls adjust it based on your need.from databricks.sdk import AccountClient, WorkspaceClient # If env vars are set, this picks them up automatically a = WorkspaceClient() # List identities u...
If I grant all privileges in my schema does that automatically give access to users for all underlying objects? Or should I give access seperately for all the objects?
Are there Houston local practitioners interested in building up the data gov (strategy, implementation, value add) group? #unitycatalog #governedtags #systemtags #abac #principals #groups
I am using Azure Databricks and Wanted to find out best way to enforce tagging to all the jobs (job compute / serverless jobs ) and follow standards any job not tagged should not run my all jobs are using asset bundle (running from github) please gui...
The easiest way to enforce tagging for jobs is to define a job cluster policy with custom_tags defined. Use this policy to create a job cluster for your production workloads. Any job that does not have the mandatory tags will fail as the job cluster ...
Is there a way to migrate a metastore to a different Databricks account in Databricks?If not, what alternative approaches can be considered? I can think of the following two:Using Delta Sharing to share objects from the source to the destination, and...
Databricks does not provide a built‑in way to “move” or migrate a Unity Catalog (UC) metastore from one Databricks account to another. Here is the list of activities that you can tryInventory & plan: Enumerate catalogs, schemas, tables (Delta vs. ext...
Can anyone share Databricks security model documentation or best-practice references
Sharing a few official Databricks security model and best-practice references that are widely used across enterprise implementations: Core Databricks Security ModelDatabricks Account & Workspace ArchitectureCovers account-level isolation, workspace b...
In my organization, we are using Databricks unity catalog and we have a metastore created for our region which holds all of our workspaces. When we created the metastore last year, we set a metastore root location for it (If I remember correctly, met...
In Databricks Unity Catalog, you’re right that you cannot simply “unset” the metastore root in place the way you would change a catalog setting. Historically, once a metastore root was defined, it stayed attached to the metastore.However, there is no...
