Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
How to edit the bucket path for the Unity Catalog metastore when it is set up laterRegistered on 2024/10 from AWS marketplace.We have created a customer management VPC and manually created the workspace.I create S3 for metastore storage from workspac...
Okay on carefully reviewing your image, doc and my internal repro > You cannot modify this path once you set it. https://docs.databricks.com/en/data-governance/unity-catalog/manage-metastore.html#step-3-add-the-storage-location-to-the-metastore
Do you need to upgrade your Hive tables and Views to Unity Catalog?You have the below options available which you can select based on the requirements:UCX: A command-line utility suite for comprehensive Unity Catalog migrations, ideal for large Hive ...
Thank you for sharing these upgrade options @Sourav-Kundu! It’s helpful to have a clear understanding of the different approaches available for migrating Hive tables to Unity Catalog.
Hi - I would like to hide function definition from user, what is the best way to do it in unity catalog
You can revoke the user's USAGE permission on that function.
Ownership of the Unity Catalog (UC) Metastore gives you permission to grant permissions to the metastore (e.g. Create Catalog). Large Organizations take one of three approaches to UC Metastore ownership (Service Principal, Global Data Admin group or ...
Thanks for sharing
Hi there,I would like to know the difference between Azure Purview and Unity catalog? Respective advantages and disadvantages.Thanks & Regards,zmsoft
Looks like now you can use directly purview with databricks and as well other system:https://www.linkedin.com/posts/bilal-bobat_microsoft-databricks-unitycatalog-activity-7257311859307958272-NfM2
Hello Databricks Community,We are working on automating the creation of an Enterprise Application for the Azure Databricks SCIM Provisioning Connector, with the goal of enabling automated user and group provisioning from Azure Active Directory (Azure...
Hi @meghana_tulla , Have you tried https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/scim/aad#automate-scim-provisioning-using-microsoft-graph ?
Hi all,I am getting an error when I try to 'Browse' an external location in catalog explorer through Databricks UI.This is the error I get: Error loading files.Input path url 'abfss://dbx-ccc-hive-metastore-unity-catalog@xxxxxxxxxx.dfs.core.windows.n...
Also, as mentioned in the kb https://kb.databricks.com/unity-catalog/invalid_parameter_valuelocation_overlap-overlaps-with-managed-storage-error You can create an external location under some-root/ as long as it does not overlap the managed table. ...
can catalog owner delete tables created by another user.
Hi meenaliNo, it is not possible. As example, I have a catalog "dspro20", where I am the owner: In this catalog, I have a schema elt and a table "target_cities":The owner is User dspro20@nona.company. When I try to delete the table, I got this error ...
Hello Briksters, i am looking for a giving a grand to developer being able execute with SHOW GROUPS WITH USER '***@***' without admin permission on UC.Could you give any tips to do it? UC Admin is able to see result query, but developer is not.
Hello all,I am looking for a way to load a persistent query history table from the query history REST API (including metrics). I do know about the system table system.query.history, but I do not have access to it.I am looking to create a python scrip...
Hi, Can you check if you have access to this? https://github.com/dbsys21/lakehouse-tacklebox/tree/main/40-observability/dbsql-query-history-sync Ideally your organization should enable the system tables and provide the necessary access, so each team ...
What permissions are actually needed in order to create a delta share?I have read that you either need to be metastore admin, or aUser with delegated permissions or ownership on both the share and the recipient objects ((USE SHARE + SET SHARE PERMISS...
Hi, Hope the doc link helps: https://docs.databricks.com/en/delta-sharing/create-share.html#requirements Specifically this statement should alleviate your immediate point. Have the USE CATALOG and USE SCHEMA privilege on the catalog and schema that...
Currently, we have implemented Unity Catalog in Databricks and we are facing an issue with lineage. We execute a notebook that fills a table, and upon completion, the lineage is created correctly; all tables are mapped properly, and we can visualize ...
What does your notebook do? Does it drop the existing tables and create a new one? Give more details about your process preferably the source code.
I am using Unity Catalog to store my models. My Unity Catalog meta-store is hosted in an Azure Storage Account, which has public network access disabled. Access is restricted to certain IP ranges and private endpoint connections only.Recently, my dev...
Got issue fixed:The issue was with Private Endpoint: we had PE with dfs sub-resource only, but mlflow uses blob, so when I created PE with blob sub-resource - the issue was fixed. (also blob DNS zone and network link is needed)
I have run into an issue with creating an External Location on an ASLS storage container with the following error :"Hierarchical Namespace (HNS) not enabledAzure storage account does not have hierarchical namespace (HNS) enabled." The Storage accoun...
I ran into the same issue, after enabling the HNS, still getting this error.
