cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

MadelynM
by Databricks Employee
  • 654 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools

Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...

Screenshot 2024-07-03 at 9.27.29 AM.png
  • 654 Views
  • 0 replies
  • 0 kudos
tyorisoo
by New Contributor
  • 177 Views
  • 2 replies
  • 0 kudos

How to edit the bucket path for the Unity Catalog metastore when it is set up later

How to edit the bucket path for the Unity Catalog metastore when it is set up laterRegistered on 2024/10 from AWS marketplace.We have created a customer management VPC and manually created the workspace.I create S3 for metastore storage from workspac...

  • 177 Views
  • 2 replies
  • 0 kudos
Latest Reply
NandiniN
Databricks Employee
  • 0 kudos

Hi @tyorisoo , Editing the Bucket Path for Unity Catalog Metastore To edit the bucket path for the Unity Catalog metastore, follow these steps: Prerequisites: Ensure you have the necessary permissions to manage the metastore and the associated S3 bu...

  • 0 kudos
1 More Replies
zmsoft
by New Contributor III
  • 115 Views
  • 3 replies
  • 4 kudos

Azure Purview VS Unity Catalog

Hi there,I would like to know the difference between Azure Purview and Unity catalog? Respective advantages and disadvantages.Thanks & Regards,zmsoft

  • 115 Views
  • 3 replies
  • 4 kudos
Latest Reply
h_h_ak
Contributor
  • 4 kudos

Looks like now you can use directly purview with databricks and as well other system:https://www.linkedin.com/posts/bilal-bobat_microsoft-databricks-unitycatalog-activity-7257311859307958272-NfM2

  • 4 kudos
2 More Replies
meghana_tulla
by New Contributor
  • 82 Views
  • 1 replies
  • 0 kudos

Automating Enterprise Application Setup for Azure Databricks SCIM Provisioning

Hello Databricks Community,We are working on automating the creation of an Enterprise Application for the Azure Databricks SCIM Provisioning Connector, with the goal of enabling automated user and group provisioning from Azure Active Directory (Azure...

  • 82 Views
  • 1 replies
  • 0 kudos
Latest Reply
NandiniN
Databricks Employee
  • 0 kudos

Hi @meghana_tulla ,  Have you tried https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/scim/aad#automate-scim-provisioning-using-microsoft-graph ?

  • 0 kudos
Snoonan
by Contributor
  • 8136 Views
  • 9 replies
  • 1 kudos

Resolved! External locations

Hi all,I am getting an error when I try to 'Browse' an external location in catalog explorer through Databricks UI.This is the error I get: Error loading files.Input path url 'abfss://dbx-ccc-hive-metastore-unity-catalog@xxxxxxxxxx.dfs.core.windows.n...

  • 8136 Views
  • 9 replies
  • 1 kudos
Latest Reply
NandiniN
Databricks Employee
  • 1 kudos

Also, as mentioned in the kb https://kb.databricks.com/unity-catalog/invalid_parameter_valuelocation_overlap-overlaps-with-managed-storage-error You can create an external location under some-root/ as long as it does not overlap the managed table. ...

  • 1 kudos
8 More Replies
meenali
by New Contributor
  • 95 Views
  • 1 replies
  • 0 kudos

Catalog permissions

can catalog owner delete tables created by another user.

  • 95 Views
  • 1 replies
  • 0 kudos
Latest Reply
Stefan-Koch
Contributor II
  • 0 kudos

Hi meenaliNo, it is not possible. As example, I have a catalog "dspro20", where I am the owner: In this catalog, I have a schema elt and a table "target_cities":The owner is User dspro20@nona.company. When I try to delete the table, I got this error ...

  • 0 kudos
Sourav-Kundu
by New Contributor II
  • 98 Views
  • 0 replies
  • 3 kudos

Upgrade your Hive tables and Views to Unity Catalog

Do you need to upgrade your Hive tables and Views to Unity Catalog?You have the below options available which you can select based on the requirements:UCX: A command-line utility suite for comprehensive Unity Catalog migrations, ideal for large Hive ...

  • 98 Views
  • 0 replies
  • 3 kudos
SHG97
by New Contributor
  • 330 Views
  • 1 replies
  • 0 kudos

Databricks master data management capabilities

Hi there,Please, I am trying to understand if Databricks is able to support master data management capabilities. Particularly, focusing on the following ones:- Integrate and link different data systems: Connect various systems and make sure the data ...

  • 330 Views
  • 1 replies
  • 0 kudos
Latest Reply
SathyaSDE
New Contributor II
  • 0 kudos

Hi,Databricks is meant for that & it supports what ever feature you had asked in the OP.1) You can ingest data from various sources - in both batch & streaming mode, various formats of data through Lakehouse architecture2) In terms of data consistenc...

  • 0 kudos
ShaSap
by New Contributor II
  • 381 Views
  • 4 replies
  • 1 kudos

Connect Purview to AWS Databricks Unity Catalog?

Hello!  Newbie here, so apologies if this is a super basic question.  Trying to figure out if we can connect Purview to an AWS instance of Databricks (vice Azure instance), but I have only seen articles on connecting Azure Databricks to Purview.  I r...

  • 381 Views
  • 4 replies
  • 1 kudos
Latest Reply
malinadiego123
New Contributor II
  • 1 kudos

¡Hola! Gracias por tu respuesta y por la información. Es útil saber que Azure Purview tiene una integración principal con Azure Databricks en consejos android, aunque la falta de soporte directo para Databricks en AWS es un punto a considerar. La ide...

  • 1 kudos
3 More Replies
Tapestry2508
by New Contributor II
  • 636 Views
  • 3 replies
  • 1 kudos

How to Delete Registered Models with Versions in Dev Environment (MLOps + DAB)

Hi all,I have a registered model deployed via DAB as part of our MLOps architecture. I'm looking to deploy this model, along with other resources (workflows, schemas, experiments, etc.), in our development environment, allowing team members to easily...

  • 636 Views
  • 3 replies
  • 1 kudos
Latest Reply
anpm
New Contributor II
  • 1 kudos

I have also run into this issue. You can delete the model programmatically in a notebook (client.delete_registered_model(name=model_name)) and then run the desired bundle command, but I would also really like a DAB native solution to this.

  • 1 kudos
2 More Replies
Cami
by Contributor III
  • 4490 Views
  • 4 replies
  • 0 kudos

Privileges for SHOW GROUPS WITH USER '***@***'

Hello Briksters, i am looking for a giving a grand to developer being able execute with SHOW GROUPS WITH USER '***@***' without admin permission on UC.Could you give any tips to do it? UC Admin is able to see result query, but developer is not. 

  • 4490 Views
  • 4 replies
  • 0 kudos
Latest Reply
jhrrezer
New Contributor II
  • 0 kudos

  • 0 kudos
3 More Replies
WWoman
by New Contributor III
  • 310 Views
  • 1 replies
  • 0 kudos

Creating a persistent query history table using the REST API

Hello all,I am looking for a way to load a persistent query history table from the query history REST API (including metrics). I do know about the system table system.query.history, but I do not have access to it.I am looking to create a python scrip...

  • 310 Views
  • 1 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

Hi, Can you check if you have access to this? https://github.com/dbsys21/lakehouse-tacklebox/tree/main/40-observability/dbsql-query-history-sync Ideally your organization should enable the system tables and provide the necessary access, so each team ...

  • 0 kudos
pernilak
by New Contributor III
  • 206 Views
  • 1 replies
  • 0 kudos

Permissions needed for creating a new (delta) share

What permissions are actually needed in order to create a delta share?I have read that you either need to be metastore admin, or aUser with delegated permissions or ownership on both the share and the recipient objects ((USE SHARE + SET SHARE PERMISS...

  • 206 Views
  • 1 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

Hi,  Hope the doc link helps: https://docs.databricks.com/en/delta-sharing/create-share.html#requirements Specifically this statement should alleviate your immediate point. Have the USE CATALOG and USE SCHEMA privilege on the catalog and schema that...

  • 0 kudos
nccodemonkey
by New Contributor III
  • 45240 Views
  • 19 replies
  • 10 kudos

Unity Catalog Shared Access Mode - dbutils.notebook.entry_point...getContext() not whitelisted

we are switching over to Unity Catalog and attempting to confirm the ability to run our existing notebooks. I have created a new Shared Unity Catalog Cluster and ran the notebook using the new cluster. Ran into an error attempting to execute a prin...

  • 45240 Views
  • 19 replies
  • 10 kudos
Latest Reply
DouglasMoore
Databricks Employee
  • 10 kudos

To replace dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson() and related APIs try:from dbruntime.databricks_repl_context import get_context token = get_context().apiToken host = get_context().browserHostName get_context().__d...

  • 10 kudos
18 More Replies
andalo
by New Contributor II
  • 283 Views
  • 2 replies
  • 0 kudos

Unity Catalog lineage is lost

Currently, we have implemented Unity Catalog in Databricks and we are facing an issue with lineage. We execute a notebook that fills a table, and upon completion, the lineage is created correctly; all tables are mapped properly, and we can visualize ...

  • 283 Views
  • 2 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

What does your notebook do? Does it drop the existing tables and create a new one? Give more details about your process preferably the source code.

  • 0 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels