cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 1083 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools

Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...

Screenshot 2024-07-03 at 9.27.29 AM.png
  • 1083 Views
  • 0 replies
  • 0 kudos
alexlod
by New Contributor III
  • 8329 Views
  • 5 replies
  • 0 kudos

Resolved! Unclear validation error message when adding a Unity Catalog metastore in Azure

I'm using Azure Databricks.I've been following this guide to create a Unity Catalog metastore using a managed identity.When I create the catalog and the validation step kicks off, I get this screen: What does this mean?If I click "Force create" and t...

Screenshot 2023-02-07 at 1.06.40 PM
  • 8329 Views
  • 5 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Alex Loddengaard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...

  • 0 kudos
4 More Replies
Guilherme
by New Contributor
  • 1999 Views
  • 2 replies
  • 0 kudos

How this is possible? access error in storage, after selecting data from an delta IN THE STORAGE

Hi people, i`m using databricks Runtime 11.2 - Clusters Standard_F4 with Unity Catalog enabled and the service principals working,I literally perform an select in two delta tables that is in the storage X, the display() works, if i try to write an ne...

  • 1999 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Guilherme Cesar​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...

  • 0 kudos
1 More Replies
iwan_aucamp
by New Contributor III
  • 3297 Views
  • 3 replies
  • 0 kudos

API to get all metastores on the account

The Unity Catalog API 2.1 only supports retrieving the unity catalogs associated with individual workspaces> The listMetastores endpoint does not list all Metstores that exist in the customer account. Instead it restricts the list by what the Workspa...

  • 3297 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Iwan Aucamp​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so w...

  • 0 kudos
2 More Replies
Gilg
by Contributor II
  • 4006 Views
  • 2 replies
  • 1 kudos

Unity Catalog and Instance Pool

Hi Team,Does Instance Pool supported in Unity Catalog enabled workspace?Cheers,G

  • 4006 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Gil Gonong​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback w...

  • 1 kudos
1 More Replies
youssefmrini
by Databricks Employee
  • 7559 Views
  • 1 replies
  • 1 kudos
  • 7559 Views
  • 1 replies
  • 1 kudos
Latest Reply
youssefmrini
Databricks Employee
  • 1 kudos

Feel free to watch a recording I made showing how to use the sync to upgrade tables from Hive metastore to Unity Catalog https://www.youtube.com/watch?v=HTiwJH9nvr8

  • 1 kudos
Garik
by New Contributor III
  • 5910 Views
  • 6 replies
  • 10 kudos

Issue with Delta Live tables access from workflow ( dlt pipelines )

Hi all,I am trying to write data from external s3 bucket to delta live tables at unity catalog( not dbfs ) from a workflow. I am seeing the following error ( saying catalog namespace is not supported. Please check full error below ) Error Detailspy4...

  • 5910 Views
  • 6 replies
  • 10 kudos
Latest Reply
Sulfikkar
Contributor
  • 10 kudos

How long should we wait to use DLT on top of the Unity catalog?

  • 10 kudos
5 More Replies
Robin_LOCHE
by New Contributor II
  • 3438 Views
  • 2 replies
  • 0 kudos

Error 'Missing Credential Scope' when using R Sparklyr on runtime > 10.4

We have multiple processing chains that uses R notebooks with Sparklyr, and we try to migrate them from runtime 10.4 to 12.2. unfortunately, there seems to be an incompatibility with Sparlyr with runtimes > 10.4:Steps to reproduce:1) Create a noteboo...

  • 3438 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Robin LOCHE​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 0 kudos
1 More Replies
ashish577
by New Contributor III
  • 13726 Views
  • 3 replies
  • 0 kudos

Is it possible to query databricks unity catalog/glue catalog delta tables from presto?

Hi,I am trying to setup presto in aws emr to be able to read delta tables. For this, as per my understanding, I need to setup the delta.properties file. Does anybody know how do I find the hive.metastore.uri that is needed for this file? For either u...

  • 13726 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

To find the hive.metastore.uri needed for the delta.properties file, you can follow the below steps:Login to your AWS Glue consoleClick on the "Crawlers" tab and select the Glue crawler that you are using for your Delta tablesIn the "Crawler details"...

  • 0 kudos
2 More Replies
Guilherme_Jorda
by New Contributor
  • 2137 Views
  • 3 replies
  • 2 kudos

Unable to link/assign a unity catalog metastore to a workspace

We are following these instructions to link/assign a unity catalog metastore to a workspace using the UI. When we apply the option to enable the unity metastore in the workspace configuration, after hitting "Update", the option gets disabled. When we...

  • 2137 Views
  • 3 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

@Guilherme Jordan​ :If the option to enable the Unity Catalog metastore in the workspace configuration is getting disabled after hitting "Update", it could be a sign of an issue with the workspace or the Unity Catalog metastore.Here are some steps yo...

  • 2 kudos
2 More Replies
kmartin62
by New Contributor III
  • 2198 Views
  • 2 replies
  • 0 kudos

Manage Account redirects me to /workspace-select instead of /data for Unity Catalog

I've been trying to set up a Unity Catalog and play around with it. For that purpose, I created a new workspace with premium tier. As a tutorial, I follow Dustin Vannoy's video (https://www.youtube.com/watch?v=-RwzDRVgjLc) where he goes to his userna...

  • 2198 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Martin Kostadinov​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your fee...

  • 0 kudos
1 More Replies
vlad_proex
by New Contributor
  • 2585 Views
  • 2 replies
  • 0 kudos

Cannot activate Unity Catalog on Databricks AWS Premium

Hello. Despite having Databricks Premium, I cannot find the options to work with Unity Catalog. I login as administrator, go to the Data section, but cannot find the option to create a Unity Metastore. What am I missing?

  • 2585 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Vlad Gheorghe​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so...

  • 0 kudos
1 More Replies
jmill
by New Contributor
  • 3716 Views
  • 4 replies
  • 3 kudos

What is best practice for organising simple desktop-style analytics workflows in Databricks?

Apologies in advance for the soft question, but I'm genuinely struggling with this.We're a small data science unit just setting up in Databricks. While we do run some intensive ETL and analytics jobs, a non-trivial part of the team's BAU is explorato...

  • 3716 Views
  • 4 replies
  • 3 kudos
Latest Reply
Vartika
Databricks Employee
  • 3 kudos

Hi @Jason Millburn​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...

  • 3 kudos
3 More Replies
Vivek_Singh
by New Contributor III
  • 1722 Views
  • 2 replies
  • 0 kudos

How to update change data UnityCatalog table after migrating hive metastore delta table

If I will migrate the Hive_metastore table into Unity Catalog table and subsequently hive metastore table is target of curation process. how I will migrate the delta record from Hive_metastore table to Unity Catalog table

  • 1722 Views
  • 2 replies
  • 0 kudos
Latest Reply
Vartika
Databricks Employee
  • 0 kudos

Hi @Vivek Singh Banafar​ Hope everything is going great.Just checking in. Does @Debayan Mukherjee​'s response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to he...

  • 0 kudos
1 More Replies
Lp6440
by New Contributor II
  • 2479 Views
  • 5 replies
  • 0 kudos

Unity catalog - access control to DB and workspace

After implementing Unity catalog, assuming a user has access to more than one DB. Can that user access all the DB in a single workspace? Can we restrict any specific DB in a workspace?

  • 2479 Views
  • 5 replies
  • 0 kudos
Latest Reply
Vartika
Databricks Employee
  • 0 kudos

Hi @Prashant Lalaiya​,Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!

  • 0 kudos
4 More Replies
Barney
by New Contributor II
  • 2471 Views
  • 2 replies
  • 0 kudos

Metastore down events in Databricks Workspace

Hi all,I see a number of metastore down events in databricks workspace: do any one know what's the reason why this happens?Thanks,Barney

  • 2471 Views
  • 2 replies
  • 0 kudos
Latest Reply
pvignesh92
Honored Contributor
  • 0 kudos

Hi @Ron Barneveld​ Could you kindly help with more details? Is this is a production metastore that you are mentioning or any metastore created by you for test environment. Also where it is hosted?

  • 0 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels