cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

marvin1
by New Contributor III
  • 1695 Views
  • 3 replies
  • 0 kudos

Hostname redaction in delta table

I am ingesting job-cluster failure notifications that we send to OpsGenie into a delta table to automate the creation and tracking of Jira tickets.  The alert notification includes the job run url, which we use to quickly respond to job failures.  Ho...

  • 1695 Views
  • 3 replies
  • 0 kudos
Latest Reply
marvin1
New Contributor III
  • 0 kudos

I tracked this issue down to running the notebook on a shared Unity-enabled cluster.  When scheduling the notebook to run on a job cluster with single user mode, this issue does not occur.

  • 0 kudos
2 More Replies
jv_v
by New Contributor III
  • 1111 Views
  • 1 replies
  • 0 kudos

Issue with "databricks metastores list" Command - Only One Metastore Listed

I have encountered with the Databricks CLI command databricks metastores list. As per our account setup, we have three metastores configured. However, when I run the command, it only returns information for one metastore instead of listing all three....

  • 1111 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ayushi_Suthar
Honored Contributor
  • 0 kudos

Hi @jv_v , Good Day!  The command you are running gives you Metastore details attached to your workspace. If you are looking to list out all the metastore present at the Account console, you can try running this below CLI command:  ------------------...

  • 0 kudos
Nivethan
by New Contributor
  • 1426 Views
  • 2 replies
  • 0 kudos

UC Enablement in Databricks workspace for metastores in different region - Azure Cloud

SpoilerWe have a UC enabled on Databricks where we have two Metastores,Metastore in West Europe regionMetastore in North America regionAnd Databricks workspace.Workspace in West Europe regionAnd we want to have a single Databricks workspace for both ...

  • 1426 Views
  • 2 replies
  • 0 kudos
Latest Reply
dkushari
New Contributor III
  • 0 kudos

Hi, Cross region metastore and workspace (WS) is not possible. It is important to understand the use case and why you have certain data in a region where you do not have a compute (WS) or do not need a compute. Ideally have each region has their own ...

  • 0 kudos
1 More Replies
erigaud
by Honored Contributor
  • 2890 Views
  • 3 replies
  • 1 kudos

Create a catalog with external location from different Metastore

Hello community !Here's my problem : I had a workspace with Unity Catalog enabled, and a catalog stored on an external location (Azure storage account). All my schemas and tables were storage on this storage. However we recently deleted the metastore...

erigaud_0-1713797409085.png
  • 2890 Views
  • 3 replies
  • 1 kudos
Latest Reply
dkushari
New Contributor III
  • 1 kudos

Hi, Looks like you are creating the catalog at the container level. Are there any other UC objects created pointing to that? Is the external location created at the container level? Can you please have a look at this and see if there is overlapping? ...

  • 1 kudos
2 More Replies
deba_nayak
by New Contributor
  • 7100 Views
  • 1 replies
  • 0 kudos

How to manage account groups

Hi All,My client has a table with user names and the authorized territory name the user has access to e.g EMEA, APAC etc. The users can also move to a different territory over time and the same will be updated in the user table table. I have multiple...

  • 7100 Views
  • 1 replies
  • 0 kudos
Latest Reply
dkushari
New Contributor III
  • 0 kudos

Hi, Can you please have a look at this example please? https://docs.databricks.com/en/data-governance/unity-catalog/row-and-column-filters.html#mapping-table-examples If you create account groups for each region and then use IS_ACCOUNT_GROUP_MEMBER t...

  • 0 kudos
wallfacer
by New Contributor II
  • 1131 Views
  • 1 replies
  • 0 kudos

Programmatically Update Table / Columns Descriptions in Unity Catalog Without Altering Table

Currently, we must re-run our DLT pipelines anytime we want to add/modify a table or column description to unity catalog.Is this the only way to add/modify unity catalog descriptions?Is there functionality within databricks cli / sdk that we can leve...

Data Governance
Databricks CLI
Databricks SDK
Product Roadmap
  • 1131 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @wallfacer, Let’s explore some options for programmatically updating table or column descriptions in Unity Catalog within Databricks: Databricks CLI and SDK: You can leverage the Databricks Command-Line Interface (CLI) and the Databricks SDK t...

  • 0 kudos
Snoonan
by Contributor
  • 6183 Views
  • 5 replies
  • 1 kudos

Resolved! External locations

Hi all,I am getting an error when I try to 'Browse' an external location in catalog explorer through Databricks UI.This is the error I get: Error loading files.Input path url 'abfss://dbx-ccc-hive-metastore-unity-catalog@xxxxxxxxxx.dfs.core.windows.n...

  • 6183 Views
  • 5 replies
  • 1 kudos
Latest Reply
gmiguel
Contributor
  • 1 kudos

Adding some tips...It seems that you have created a metastore with root path definition (metastore-level managed storage). If you're planning to deploy a multi-workspace environment (Development, QA and Production), I strongly recommend you to change...

  • 1 kudos
4 More Replies
jpaladini
by New Contributor II
  • 2152 Views
  • 2 replies
  • 0 kudos

Can't enable delta sharing inside metastore

Hi,I'm currently using Unity Catalog and serving as the metastore admin. However, I've encountered an issue where I cannot select the "Enable Delta sharing to allow a Databricks user to share data outside their organization" checkbox as it appears to...

  • 2152 Views
  • 2 replies
  • 0 kudos
Latest Reply
shan_chandra
Esteemed Contributor
  • 0 kudos

@jpaladini - could you please let us know if you had a chance to follow the steps to setup Delta Sharing on your workspace - https://docs.databricks.com/en/data-sharing/set-up.html#enable-delta-sharing-for-your-account?

  • 0 kudos
1 More Replies
crimson
by New Contributor II
  • 2589 Views
  • 2 replies
  • 0 kudos

Loading Keras model from ADLS

I want to load a Keras model using abfss. As far as I know, this is not possible, and the only way of doing this is by copying the model from ADLS to dbfs.I am concerned about the data governance, as everybody could potentionally modify/delete the mo...

Data Governance
ADLS
keras
  • 2589 Views
  • 2 replies
  • 0 kudos
Latest Reply
crimson
New Contributor II
  • 0 kudos

Hi @Kaniz_Fatma,Can you please elaborate on these or share related documentation?Use Access Control Lists (ACLs) or Shared Access Signatures (SAS) to restrict access further.Is it possible to use ACLs to control DBFS access?Serialize your Keras model...

  • 0 kudos
1 More Replies
nccodemonkey
by New Contributor III
  • 38334 Views
  • 18 replies
  • 9 kudos

Unity Catalog Shared Access Mode - dbutils.notebook.entry_point...getContext() not whitelisted

we are switching over to Unity Catalog and attempting to confirm the ability to run our existing notebooks. I have created a new Shared Unity Catalog Cluster and ran the notebook using the new cluster. Ran into an error attempting to execute a prin...

  • 38334 Views
  • 18 replies
  • 9 kudos
Latest Reply
JakubMlacki
New Contributor II
  • 9 kudos

I faced the same issue when switching to Shared Access cluster and found that there is a possibility to run :dbutils.notebook.entry_point.getDbutils().notebook().getContext().safeToJson()Hope this helps

  • 9 kudos
17 More Replies
Karlo_Kotarac
by New Contributor III
  • 2053 Views
  • 2 replies
  • 0 kudos

Databricks autocomplete uses hive_metastore catalog although we have other default catalog

Databricks autocomplete is checking the hive_metastore catalog when I enter the schema_name and table_name in the notebook although we have other default catalog set at the workspace level. How to make Databricks autocomplete use that catalog when en...

  • 2053 Views
  • 2 replies
  • 0 kudos
Latest Reply
Karlo_Kotarac
New Contributor III
  • 0 kudos

Hi @Kaniz_Fatma ! Thanks for your answer. I forgot to mention that we already have this set up at the cluster level (using spark.databricks.sql.initial.catalog.name variable) besides setting this on the workspace level in the workspace settings but n...

  • 0 kudos
1 More Replies
Kibour
by Contributor
  • 29986 Views
  • 3 replies
  • 0 kudos

git reset

Hi all,Since the last update of Databricks (21.03.2024), I can't find the option to git reset my repo anymore. Where did it go?Thanks in advance for your guidance!

  • 29986 Views
  • 3 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

Yay!  I guess it was an oopsie

  • 0 kudos
2 More Replies
Cami
by Contributor III
  • 3571 Views
  • 2 replies
  • 1 kudos

Privileges for SHOW GROUPS WITH USER '***@***'

Hello Briksters, i am looking for a giving a grand to developer being able execute with SHOW GROUPS WITH USER '***@***' without admin permission on UC.Could you give any tips to do it? UC Admin is able to see result query, but developer is not. 

  • 3571 Views
  • 2 replies
  • 1 kudos
Latest Reply
Cami
Contributor III
  • 1 kudos

Thank you for your comprehensive answer.I assume from what you have written that this cannot be done without admin permissions on the metastore.So is there any other way to check who is in which group?

  • 1 kudos
1 More Replies
Priyam1
by New Contributor III
  • 2295 Views
  • 3 replies
  • 0 kudos

The Giant logo of Databricks

I have tried different browsers and deleting cache despite that I am seeing this giant logo of databricks on the workspace home page and multiple people in our org are having this issue.

  • 2295 Views
  • 3 replies
  • 0 kudos
Latest Reply
Priyam1
New Contributor III
  • 0 kudos

 

  • 0 kudos
2 More Replies
Synasenn
by New Contributor II
  • 3428 Views
  • 2 replies
  • 1 kudos

Resolved! Unity catalog; how to remove tags completely?

Hi,We are rolling out Unity in our organization and while playing around I had set some tags on a test catalog.After removing this catalog, the tag keys I used are still present in our Unity environment and I am unable to find where they are stored t...

Synasenn_0-1712216775874.png
  • 3428 Views
  • 2 replies
  • 1 kudos
Latest Reply
Synasenn
New Contributor II
  • 1 kudos

Thanks! I will take that to heart and include it on our internal wiki

  • 1 kudos
1 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels