Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
When creating a data share in my Databricks workspace, in the step Add data assets, one of my schemas in Unity Catalog shows 'No data' when expanding. If I expand the same schema in Unity Catalog explorer, it shows lots of tables and all tables conta...
Hello @Anske , This feature is currently in private preview. You should contact your account team to have it enabled in your workspace(s). Requirements Databricks Runtime (DBR) 13.3 or aboveRecipients must use Serverless SQL warehouse to query a shar...
Is it OK to provide consent to databricks support person to execute notebook in our workspace...Actually we encountered on technical issue related Mount Exception. Databricks support person is asking for consent to access our workspace in order to ex...
Hello you can indeed provide consent to the run the notebook if needed, but if you have security concerns you can also deny this access and suggest the support person to sync up on a call to execute the process and collect any log that might be neede...
I am trying to connect to Unity catalog meta store tables using Presto Based on the presto documentation I need to use the below configuration to connect to delta tables in the unity catalog https://prestodb.io/docs/current/connector/hive.htmlSo from...
Hello @Akshith_Rajesh, In order to connect Trino to Unity Catalog HMS, please use this configuration instead: hive.metastore.uri=https://<DATABRICKS_HOST>:443/api/2.0/unity-hms-proxy/metadata hive.metastore.http.client.bearer-token=${ENV:DATABRICKS_T...
I noticed in the Catalog Explorer of an Unity Catalog integrated workspace that there is a default catalog named 'system' owned by 'System user'. Who is this system user? It is not listed in the admin dashboard of all workspace users.
Is a special user account created by Databricks for managing system-level operations and configurations. This user is not listed in the admin dashboard of all workspace users because it is not a regular user account but rather a system account used i...
Hi, i try to used Unity Catalog in my workspace but i don´t get it!I have followed all the steps in this video and this is my group resource in Azure: After, i change Access control (IAM):Now i have the rol as Administrator and Owner in workspace.But...
Hi Everyone,I’m facing the same issue with Azure Databricks and was hoping someone could help.When I create an Azure Databricks workspace using the Azure subscription provided by my company, the workspace automatically attaches to the company’s Activ...
Hello,Very excited to see the UC federation for hive and aws glue are now in public review. I have a workspace with hive metastore and it integrates with AWS glue (https://docs.databricks.com/en/archive/external-metastores/aws-glue-metastore.html). T...
Hello @hzh, Thanks for your question! UC Federation Connection Type and Metastore Type When creating a connection for UC federation with a Hive metastore integrated with AWS Glue, the connection type should be Hive metastore. Metastore Type If the Hi...
Created a UC volume on the dev lane and, surprisingly, was able to see the same on all the other ADB subscriptions.did i miss anything ?
Then, that is the reason why, the visibility of the UC volume across all your ADB subscriptions is expected behavior if they share the same metastore within the same region and tenant
Hi,In our Azure tenant We have deleted a Unity Catalog registered workspace and ticked the Delete default workspace storage permanentlyThere are 2 catalogs that were created in that workspace that are now greyed out in the catalog explorer when acces...
databricks catalogs delete --name my-catalog --force Thanks for the help ! Needed the force as the catalog was not empty. Also required a change of ownership of catalog to metastore owner.
we are using mount points via service principals approach to connect the storage account. and using the same mount points to create external tables in hive meta store. but now we are trying using only service principals setup ,so we need to change t...
Hi @mysura, Is your workspace Unity Catalog enabled? do you have a metastore assigned? I think legacy hive_metastore will not support service principal to do this change. I think the best approach is to create an external location based on the adfss ...
Is there a feature update request or resolution for adding service endpoints to the worker-vn that databricks created? We are experiencing 403 errors for IP authorizations from the worker-vn and do not have the permissions to update the service endpo...
In my workspace, I'm able to see the unity catalogs my team has created. I'm able to see the schemas and even query data in there and create views using the SQL Editor.When I go to write the same sql queries from a notebook using spark.sql or %sql I ...
i know this is an old topic, but i have the same issue with querying data using the sql editor and a sql warehouse. my sql warehouse does have unity catalog enabled. not sure why it wouldnt be working.
I've been followig this documentation to get Salesforce Data Cloud connection setup into Databrickshttps://learn.microsoft.com/en-us/azure/databricks/query-federation/salesforce-data-cloudI've added the client id and secret id and the scope, and it s...
Hi @KristiLogos , Good Day! We understand that you are facing the following error while you are trying to create a connection with Salesforce, but since it's been a long time, we wanted to check if you are still facing the issue or if it's resolved ...
I am trying to list OBO tokens that have been created for service principals. I tried using the Token Management API 2.0 (https://docs.databricks.com/dev-tools/api/latest/token-management.html#operation/get-tokens) to list workspace tokens, but it on...
Hi @Nick Tran​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
Watch the youtube video : https://www.youtube.com/watch?v=S9LLpMvAcT4
This is a great video! It's really helpful to see how to control access to catalogs in Unity Catalog. I especially like the part about granting read-only access to production data. This is a great way to allow data analysts to do their work without g...
Hi,As part of the DataGovernance or Authorization topic we are working on automation of the code for granting the access CATALOG LEVEL,SCHEMA LEVEL and TABLE LEVEL in Unity CatalogAs USE CATALOG Provides access at the Catalog level to user/group(whic...
USE is foundational. You need it at the catalog level and for any schema you want to access. So let's say I need SELECT only on 1 table T1 in Catalog:C1, Schema:S1 (Though there may be 1K tables in that schema) Then I would need USE CATALOG on C1;USE...
