If you're catching up on Data + AI Summit 2026, here’s a simple Unity Catalog recap for data governance. Three themes stand out: Control, Context, and Choice. Control: Keep governance consistent as AI moves from access to action. AI governance at Dat...
In the article Manage budgets and cost controls for Genie at Manage budgets and cost controls for Genie - Azure Databricks | Microsoft Learn it mentions setting the resource type of Unity AI gateway from the dropdown. However when using Account Conso...
Hi @AndyRoyle, Per the public docs, the expected flow is that once that preview is enabled, you go to the Budgets page in Account Console, and the budget definition should show a Resource types dropdown where you can choose Unity AI Gateway. You can ...
Hi everyone,Don't know where to put this specific question. I'm working on a reference data mesh implementation to connect and combine datasets to find matching trials for patients with a specific genetic profile. - Do you know anyone that might be i...
Hi @steff_horemans, My guess is that the Free Edition is probably not the best place to demonstrate true external sharing. Free Edition is positioned as a serverless-only, quota-limited, non-commercial environment, with one workspace, one metastore, ...
While learning about Databricks foreign catalogsn (I'm on free tier DBX account), seems theres 2 ways creating foreign catalog to Snowflake:via CONNECTION type=snowflake, seems jdbc connection through where DBX pulls all metadata of 1 snowflake datab...
Hi, Appreciate the detailed pushback. A few of the technical claims here are mixing up two distinct Databricks mechanisms, so let me separate them, because the answer changes depending on which one you mean. 1. Snowflake catalog federation does not r...
For AWS and GCP, the discounts provided by Databricks can be found in system.billing.account_prices table. How can we find the same in Azure?
Hi @nara_shikamaru Azure Databricks is a native service similar to Synapse in Azure unlike others. Databricks generally never sees the final aligned price and hence its unavailable in system tables.You can follow belowAzure Daily Export - You can exp...
Hi there,I was checking though the Databricks Runtime 17.0 features while testing:Support ALL CATALOGS in SHOW SCHEMASI faced below issues, is that anticipated or an issue which needs to be fixed?This is how it was before Runtime 17.0 I was expectin...
HI @creativeIndex, I stumbled upon this while looking for something else. I appreciate it's been a while, but I realise you haven't received a solution yet. Is this still an issue? I just wanted to point out that you should use an asterisk (*) instea...
We have three tables A, B, C in the same schema, I want to grant user permission to view only the metadata of table A, cannot see underlying data of A.User can not see table B and C including table schema and underlying data either.Is it possible to...
Hi , As already covered by other contributors, what you want is only partially possible in Unity Catalog. You can make a user see metadata for a table without being able to read its data by using the BROWSE privilege. Databricks documents that BROWSE...
Hi!By default it seems users can only see tables and views in Unity Catalog that they have SELECT permission/privilege on. However, we would like to use Unity Catalog as a data catalog of tables we have. They wouldn't then be able to request access t...
@Shivam7788775 Hello, I have a similar question about the BROWSE permission management.We have three tables A, B, C in the same schema, I want to grant user only permission to view the only metadata of table A, cannot see underlying data of A. User c...
Hi Team,I have created databricks finops dashboard and within that I have provided recommendations on cluster auto termination. But I wanted add one more column like how much we can save after reducing auto termination time. How can I add that in my ...
For each cluster:Savings = Avoidable Idle Time × Hourly CostWhere:Avoidable Idle Time (minutes) = estimated minutes the cluster kept running after it became idle, beyond the recommended termination window.Hourly Cost = DBU cost + (optional) cloud com...
Hi All, Can anyone point me to either documentation or personally tried and tested method of backing up (and restoring) Unity Catalog and its associated managed tables? We're running on Azure and using ADLS Gen2.Regards,Ashley
This can be via 3rd party tool called commvault : https://documentation.commvault.com/11.42/software/protect_databricks_using_commvault.html
I changed the administrative permissions for a specific service principal in the account management screen.I expected an audit log to be generated with service_name = accountns and action_name = changeServicePrincipalAcls, as described in the audit l...
As we all know, the main method of cost attribution for serverless compute is with budget (sometimes called usage) policies (Public Preview). This is a new paradigm compared with the tagging of both classic compute and serverless SQL warehouses.The J...
Thank you for your reply! This adds clarity to my confusion regarding serverless tagging. This information would have helped a lot if it was included in the official documentation. You should considering sending the technical documentation team your ...
Hi,I want to import Databricks metadata information from unity catalog including lineage into GCP Dataplex governance solution. Can you let me know the how this can be achieved.Similar to Purview and Unity Catalog integration, are there APIs to push ...
Hi Walter,Is it possible to migrate Databricks Unity Catalog data from Databricks to Google Dataplex without using API calls? What's the efficient way to move Unity Catalog data from Databricks to Google Dataplex? Please explain the steps. Thank you ...
Hi everyone,I’m curious if anyone has successfully implemented Databricks Genie (chat/agent) for production use.Currently, we’ve enabled a few Genie instances for power users who are comfortable working with data outside of the data team. However, we...
Hi Julie, thanks for sharing the screenshot. There are a few things we'd recommend to customers when they are starting out on a Genie journey, we defintiely see enterprises creating Genie spaces at scale but it needs some thought and guardrails. Some...
I have a Python-based FastAPI application with a React frontend, which I would like to deploy to Databricks apps. I'm able to do it, but having trouble with file system access. In addition to database access, my application relies on some file operat...
In the end, I just added the wheel to the app's source code and installed from there. Not ideal, but the module is small and checking the wheel into git was the lesser issue.This workaround runs fine for a few months now. My build pipeline takes care...
How is Unity Catalog managed in real time at an enterprise scale, including workspace-level restrictions, privilege-based ACLs, row- and column-level security, ABAC, and tag-driven governance, and which languages or tools are used to manage the entir...
Thank you... Which roles ( workspace admin or Metastore Admin) are recommended to securely create and manage Unity Catalog objects (Storage Credentials, External Locations, Catalogs, Schemas, and Delta Sharing)?” and why ?
