cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

bragoarefur
by Visitor
  • 44 Views
  • 0 replies
  • 0 kudos

best alternative to webhooks with Unity Catalog?

We have been using the feature MLflow Model Registry Webhooks on Azure Databricks . Webhooks are in public preview, but oddly are deprecated at the same time with the introduction of Unity Catalog. The documentation says "For an alternative, see Can ...

  • 44 Views
  • 0 replies
  • 0 kudos
DouglasMoore
by Databricks Employee
  • 2452 Views
  • 1 replies
  • 1 kudos

Unity Catalog Metastore Ownership best practices

Ownership of the Unity Catalog (UC) Metastore gives you permission to grant permissions to the metastore (e.g. Create Catalog). Large Organizations take one of three approaches to UC Metastore ownership (Service Principal, Global Data Admin group or ...

DouglasMoore_2-1726493355536.png DouglasMoore_1-1726493307002.png DouglasMoore_0-1726493057063.png DouglasMoore_3-1726493872334.png
  • 2452 Views
  • 1 replies
  • 1 kudos
Latest Reply
Rafael-Sousa
New Contributor III
  • 1 kudos

Thanks for sharing

  • 1 kudos
Christine
by Contributor II
  • 60940 Views
  • 19 replies
  • 19 kudos

Resolved! Cannot use RDD and cannot set "spark.databricks.pyspark.enablePy4JSecurity false" for cluster

I have been using "rdd.flatMap(lambda x:x)" for a while to create lists from columns however after I have changed the cluster to a Shared acess mode (to use unity catalog) I get the following error: py4j.security.Py4JSecurityException: Method public ...

  • 60940 Views
  • 19 replies
  • 19 kudos
Latest Reply
de-qrosh
New Contributor II
  • 19 kudos

Hello,In the past I used rdd.mapPartitions(lambda ...) to call functions that access third party APIs like azure ai translate text to batch call the API and return the batched data.How would one do this now? 

  • 19 kudos
18 More Replies
Tapestry2508
by New Contributor II
  • 733 Views
  • 3 replies
  • 1 kudos

How to Delete Registered Models with Versions in Dev Environment (MLOps + DAB)

Hi all,I have a registered model deployed via DAB as part of our MLOps architecture. I'm looking to deploy this model, along with other resources (workflows, schemas, experiments, etc.), in our development environment, allowing team members to easily...

  • 733 Views
  • 3 replies
  • 1 kudos
Latest Reply
anpm
New Contributor II
  • 1 kudos

I have also run into this issue. You can delete the model programmatically in a notebook (client.delete_registered_model(name=model_name)) and then run the desired bundle command, but I would also really like a DAB native solution to this.

  • 1 kudos
2 More Replies
WWoman
by New Contributor III
  • 314 Views
  • 1 replies
  • 0 kudos

Creating a persistent query history table using the REST API

Hello all,I am looking for a way to load a persistent query history table from the query history REST API (including metrics). I do know about the system table system.query.history, but I do not have access to it.I am looking to create a python scrip...

  • 314 Views
  • 1 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

Hi, Can you check if you have access to this? https://github.com/dbsys21/lakehouse-tacklebox/tree/main/40-observability/dbsql-query-history-sync Ideally your organization should enable the system tables and provide the necessary access, so each team ...

  • 0 kudos
nccodemonkey
by New Contributor III
  • 45395 Views
  • 19 replies
  • 10 kudos

Unity Catalog Shared Access Mode - dbutils.notebook.entry_point...getContext() not whitelisted

we are switching over to Unity Catalog and attempting to confirm the ability to run our existing notebooks. I have created a new Shared Unity Catalog Cluster and ran the notebook using the new cluster. Ran into an error attempting to execute a prin...

  • 45395 Views
  • 19 replies
  • 10 kudos
Latest Reply
DouglasMoore
Databricks Employee
  • 10 kudos

To replace dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson() and related APIs try:from dbruntime.databricks_repl_context import get_context token = get_context().apiToken host = get_context().browserHostName get_context().__d...

  • 10 kudos
18 More Replies
andalo
by New Contributor II
  • 303 Views
  • 2 replies
  • 0 kudos

Unity Catalog lineage is lost

Currently, we have implemented Unity Catalog in Databricks and we are facing an issue with lineage. We execute a notebook that fills a table, and upon completion, the lineage is created correctly; all tables are mapped properly, and we can visualize ...

  • 303 Views
  • 2 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

What does your notebook do? Does it drop the existing tables and create a new one? Give more details about your process preferably the source code.

  • 0 kudos
1 More Replies
jerickson
by New Contributor II
  • 714 Views
  • 3 replies
  • 0 kudos

CREATE EXTERNAL LOCATION on a publicly available S3 bucket

I would like to create an external location on a publicly available S3 bucket, for which I don't have credentials. I get a syntax error unless I include credentials. Is there a way to do this? CREATE EXTERNAL LOCATION public_bucket URL 's3://public_b...

  • 714 Views
  • 3 replies
  • 0 kudos
Latest Reply
filipniziol
Contributor
  • 0 kudos

Hi @jerickson ,I have tested this on Databricks Runtime 14.3 LTS:Install on the cluster the below Maven packages:com.amazonaws:aws-java-sdk-bundle:1.12.262org.apache.hadoop:hadoop-aws:3.3.4Run the below code to read your csv file into dataframe: spar...

  • 0 kudos
2 More Replies
Gilg
by Contributor II
  • 1618 Views
  • 3 replies
  • 0 kudos

Delta Sharing within the same region

Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...

  • 1618 Views
  • 3 replies
  • 0 kudos
Latest Reply
NikunjKakadiya
New Contributor II
  • 0 kudos

Do we have any updates on this in terms of how we can share the data between different workspaces part of the same metastore?

  • 0 kudos
2 More Replies
Praveen
by New Contributor II
  • 602 Views
  • 1 replies
  • 0 kudos

Enable external data access on the metastore

Hello Everyone,I have an AWS Databricks premium trial account and I’m trying to enable the configuration "Enable external data access on the metastore" for a metastore. I followed the steps in the official documentation (https://docs.databricks.com/e...

Praveen_0-1727338697909.png
  • 602 Views
  • 1 replies
  • 0 kudos
Latest Reply
saikumar246
Databricks Employee
  • 0 kudos

Hi @Praveen Thank you for sharing your concern here. You are looking into the Catalog on the account console, but according to the document, you have to do this in the Workspace Catalog UI. Please follow the below steps, Log into any of the workspace...

  • 0 kudos
Karol1977
by New Contributor
  • 377 Views
  • 1 replies
  • 0 kudos

example how to search by both tag key and tag value

Hi,Could you please give me example how to search by both tag key and tag value?This article doesn't show such example: https://docs.databricks.com/en/search/index.html#tagsThanks,Karol

  • 377 Views
  • 1 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

If you want to search by tag key alone, use the syntax: tag:<tag_key>. To search by both tag key and tag value, omit tag:. https://docs.databricks.com/en/search/index.html#use-tags-to-search-for-tables  

  • 0 kudos
Daithi
by New Contributor II
  • 15731 Views
  • 14 replies
  • 3 kudos

Unity Catalog - Error getting sample data in data explorer

I get an error message saying I Error getting sample data, when I try to view sample data from a table in a schema I created in a Unity Catalog. I dropped the schema and table and got a collague to recreate and still the same message. We are both Uni...

image.png
  • 15731 Views
  • 14 replies
  • 3 kudos
Latest Reply
michalama
New Contributor II
  • 3 kudos

The cluster access mode can be set to either Shared or Single User, depending on your needs, or you can opt to use an SQL Warehouse for cluster management.

  • 3 kudos
13 More Replies
vmpmreistad
by New Contributor II
  • 5257 Views
  • 1 replies
  • 1 kudos

CREATE OR REPLACE VIEW removes permissions [Unity Catalog]

When I run CREATE OR REPLACE VIEW on an existing view in Unity Catalog, the grants that were made on that object are removed. This seems like it is a bug. Is it on purpose or not?How to replicate:1. Create the viewRun the create or replace statement:...

Data Governance
Unity Catalog
  • 5257 Views
  • 1 replies
  • 1 kudos
Latest Reply
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 1 kudos

This widget could not be displayed.
When I run CREATE OR REPLACE VIEW on an existing view in Unity Catalog, the grants that were made on that object are removed. This seems like it is a bug. Is it on purpose or not?How to replicate:1. Create the viewRun the create or replace statement:...

This widget could not be displayed.
  • 1 kudos
This widget could not be displayed.
h_aloha
by New Contributor III
  • 39231 Views
  • 12 replies
  • 1 kudos

[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster

Hi,I got error [UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster, when run in the notebook to create a catalog. Looks like I followed all the steps to set up workspace, metastore and compute. The steps are:create workspace from UI -> Qu...

  • 39231 Views
  • 12 replies
  • 1 kudos
Latest Reply
Sanjay_AMP
New Contributor II
  • 1 kudos

I had faced the same problemI recreated the cluster (after enabling Unity Catalog) and it is working now

  • 1 kudos
11 More Replies
Labels