cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Ajay-Pandey
by Esteemed Contributor III
  • 9386 Views
  • 10 replies
  • 4 kudos

Resolved! Step by step process to create Unity Catalog in Azure Databricks

Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.

  • 9386 Views
  • 10 replies
  • 4 kudos
Latest Reply
juanp9
New Contributor II
  • 4 kudos

Hi everyone!I have an Azure for Students subscription. Since I am unable to be an Azure Active Directory Global Administrator, I tried but it is restricted by the organization to add my user as a Global Administrator, I guess with an Azure for Studen...

  • 4 kudos
9 More Replies
Ajay-Pandey
by Esteemed Contributor III
  • 5561 Views
  • 7 replies
  • 9 kudos

Resolved! Delta sharing without unity catalog

Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?

  • 5561 Views
  • 7 replies
  • 9 kudos
Latest Reply
Lipu
New Contributor II
  • 9 kudos

Is it possible to receive data in databricks notebook without enabling the unity catalog?

  • 9 kudos
6 More Replies
ajbush
by New Contributor III
  • 10807 Views
  • 1 replies
  • 1 kudos

Unity Catalog permissions approach for strict controls when creating tables

Hi all,I'm deploying Unity Catalog into a large enterprise with quite strict controls. I want to give my users some autonomy over creating tables from upstream datasets they have select access on, but also restrict these controls. I've been through a...

  • 10807 Views
  • 1 replies
  • 1 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 1 kudos

A schema contains tables, views, and functions. You create schemas inside catalogs .RequirementsYou must have the USE CATALOG and CREATE SCHEMA data permissions on the schema’s parent catalog. Either a metastore admin or the owner of the catalog can ...

  • 1 kudos
Alex006
by Contributor
  • 11698 Views
  • 9 replies
  • 10 kudos

Resolved! Metastore creation - Azure Databricks - Access validation failed

Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...

Access validation failed when trying to create a metastore Role assignment to azure databricks connector in the storage account
  • 11698 Views
  • 9 replies
  • 10 kudos
Latest Reply
abarber
New Contributor II
  • 10 kudos

I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.

  • 10 kudos
8 More Replies
vexor
by Contributor
  • 14713 Views
  • 15 replies
  • 22 kudos

How to resolve problem with upgrading external table to Unity Catalog?

I have a problem with upgrading table to Unity Catalog, I got the error:summary:Error in SQL statement:AnalysisException:org.apache.hadoop.hive.ql.metadata.HiveException:Unable to fetch table calexception. Exception thrown when executing query :SELEC...

  • 14713 Views
  • 15 replies
  • 22 kudos
Latest Reply
vexor
Contributor
  • 22 kudos

Hi Vidula,Unfortunately none of the answers answered my question.

  • 22 kudos
14 More Replies
mimoliho
by New Contributor II
  • 8307 Views
  • 3 replies
  • 2 kudos

Query information schema under Catalogs from Tableau Desktop - what are the permissions?

Hi there,We have Unity Catalogs enabled in Azure Databricks.I would like to connect to system.information_schema.* or any other *.information_schema.*. Querying in UI or other IDEs works as expected - select * from system.information_schema.tables.No...

no_system_catalog system_catalog syste_catalog_inf system_catalog_table
  • 8307 Views
  • 3 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Egor Larin​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!

  • 2 kudos
2 More Replies
ryan321321
by New Contributor III
  • 18144 Views
  • 9 replies
  • 8 kudos

Unity Catalog-Error Creating Table ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException

I have managed to create my catalog and schema on unity catalog. Added Storage Blob Contributor role to the unity catalog metastore in ADLS for the Access Connector for Azure Databricks.however, when trying to create a table i received this error:Err...

image.png image image
  • 18144 Views
  • 9 replies
  • 8 kudos
Latest Reply
Anonymous
Not applicable
  • 8 kudos

Hi @adam wong​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback wi...

  • 8 kudos
8 More Replies
alexlod
by New Contributor III
  • 7221 Views
  • 5 replies
  • 0 kudos

Resolved! Unclear validation error message when adding a Unity Catalog metastore in Azure

I'm using Azure Databricks.I've been following this guide to create a Unity Catalog metastore using a managed identity.When I create the catalog and the validation step kicks off, I get this screen: What does this mean?If I click "Force create" and t...

Screenshot 2023-02-07 at 1.06.40 PM
  • 7221 Views
  • 5 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Alex Loddengaard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...

  • 0 kudos
4 More Replies
Vivek_Singh
by New Contributor III
  • 3185 Views
  • 5 replies
  • 5 kudos

Resolved! enabled the unity catalog having Premium subscription

Hello All, I am using Premium subscription and have admin access in workspace, however I am not able to get the option to create metastore for unity catalog

  • 3185 Views
  • 5 replies
  • 5 kudos
Latest Reply
Anonymous
Not applicable
  • 5 kudos

Hi @Vivek Singh Banafar​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your f...

  • 5 kudos
4 More Replies
Arpi
by New Contributor II
  • 1989 Views
  • 2 replies
  • 0 kudos

Delta table error

Hi,we are creating an external table in the Azure databricks but facing this error:org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.meta...

  • 1989 Views
  • 2 replies
  • 0 kudos
Latest Reply
karthik_p
Esteemed Contributor
  • 0 kudos

@Priyanka Biswas​ is there a place where we can have updates on metastore upgrades or control plane individual components. usually we can only see control plane region wide status

  • 0 kudos
1 More Replies
parulpaul
by New Contributor III
  • 4998 Views
  • 6 replies
  • 9 kudos

I do not find "Create Catalog "and "Create Metastore" on Azure Databricks.

I am trying to set up Unity Catalog in Azure Databricks following this documentation Unity Catalog, but I do not find "Create Metastore" and "Create Metastore" on Databricks.Please help with the same, how can I enable Unity Catalog.

  • 4998 Views
  • 6 replies
  • 9 kudos
Latest Reply
parulpaul
New Contributor III
  • 9 kudos

This issue is resolved. Thank you @Camilla Lok​ and @Harun for the suggestions. It works fine after enabling Global administrators in Azure Active Directory .

  • 9 kudos
5 More Replies
rammy
by Contributor III
  • 3973 Views
  • 4 replies
  • 7 kudos

There is no response when invoking the REST service in Databricks notebook

I am trying to invoke a REST service from Databrcisks notebook using python programming. It is working fine before enabling Unity Catalog but after enabling it (In another environment) it is not working and never giving any response and not showing a...

  • 3973 Views
  • 4 replies
  • 7 kudos
Latest Reply
Prabakar
Databricks Employee
  • 7 kudos

I suspect the problem could be caused by the cluster mode. What type of cluster or what access mode do you use for your cluster?

  • 7 kudos
3 More Replies
evega
by New Contributor III
  • 10097 Views
  • 11 replies
  • 1 kudos

Azure Create Metastore button not available

Dear community, I want to configure the unity catalog with databricks, but the Create MetaStore button does not appear in my Azure Databricks workspace.In the community, I have seen that several users present the same situation ... What is the reason...

  • 10097 Views
  • 11 replies
  • 1 kudos
Latest Reply
evega
New Contributor III
  • 1 kudos

Hello Databricks Community, good news! I already found the solution: To login as an administrator, it is necessary to have the role of global administrator on the azure subscription, otherwise it will never appear.

  • 1 kudos
10 More Replies
Matt101122
by Contributor
  • 2704 Views
  • 2 replies
  • 9 kudos

Resolved! Unity Catalog Setup: Why must the first Azure Databricks account admin must be an Azure Active Directory Global Administrator at the time that they first log in to the Azure Databricks account console?

We are attempting to setup Unity Catalog and our security team is requesting justification on why this level of access is required. Why must the first Azure Databricks account admin must be an Azure Active Directory Global Administrator at the time t...

  • 2704 Views
  • 2 replies
  • 9 kudos
Latest Reply
LandanG
Databricks Employee
  • 9 kudos

Hi @Matthew Dalesio​ From our eng. team:"The high privileged is only used to make sure only highly privileged users get access to Databricks account admin role as this is a highly-privileged role and they can make anyone else an account admin. This i...

  • 9 kudos
1 More Replies
rammy
by Contributor III
  • 5858 Views
  • 4 replies
  • 15 kudos

How would i upload file stream object to S3 bucket using pyspark?

I could able to save data using pyspark into S3 but not sure on how to save a file stream object into S3 bucket using pyspark. I could achieve this with help of python but when Unity catalog was enabled on Databrciks it always ends up with an access ...

  • 5858 Views
  • 4 replies
  • 15 kudos
Latest Reply
rammy
Contributor III
  • 15 kudos

I got to know that there is a change required at Unity-catalog to make it work with Python and got a recommendation to use pyspark to store file into S3.I do not see much information about storing a file stream object in an S3 bucket anywhere. Can an...

  • 15 kudos
3 More Replies
Labels