Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
I am attempting to execute the following command from a notebook on a runtime 10.4 cluster, but I'm encountering an error: "current user does not have privilege USAGE on Catalog".To provide some context, I am using DBR 10.4 specifically because I nee...
@drii_cavalcanti From the error, we could see that you do not have permission to use the catalog. I suppose you are using Unity Catalog. You should 3 levels of permissions to access the Catalog, schema and then tables.You can refer to this document -...
Hi everyone,Just wondering if I copy the catalog folders (under the metastore storage) to a different s3 bucket, once I have a new metastore with a new ID I can restore the tables as they were <catalog_name>.<schema_name>.<table_name> into the new me...
We are in the process of integrating the Unity Catalog with the workspaces across our organization. As a preliminary step, we need to designate a Databricks Account Admin.Our Azure tenant encompasses multiple subscriptions, each hosting distinct work...
Hello,I want to grant 'select' option on some columns in my table.So i created view, and now people can access my view but cannot access the table.However, they cannot do 'select' on the view, because they do not have privileges to the table.What can...
To sum up,It is not possible to create a view based on a table that someone does not have permission to.It's a pity, because this option would be very useful to limit access to batch-fed tables.Thanks all for the help and your time!Regards,Łukasz
I am trying to create an external table using csv file which is stored in ADLS gen2 My account owner has created a storage credential and an external location I am a databricks user who all privileges on external location when trying to create a tabl...
HiUnity Metastore can currently only be provisioned once for each Azure region. I have three environments in Azure each consisting of a separate Subscription and Resource Group (RG). Each RG contains a Databricks Workspace and a Storage Account holdi...
Ask and ye shall receive: https://github.com/databricks/terraform-provider-databricks/releases/tag/v1.24.0They've implemented account-level UC API in terraform now!
In my Databricks regular Clusters, Our clusters are configured to an External Hive Meta Store (Azure SQL Server). I am able to set the External Hive configuration in the Advanced options Spark config setting within the cluster setting. In our setting...
@RafaelGomez61 I have the some problem and after some exploring, I've configured it and also wrote a blog for the whole steps. You can have a look here: https://medium.com/@judy3.yang/how-to-configure-external-hive-meta-store-for-databricks-sql-wareh...
I'm looking to migrate onto unity catalog but a number of my data ingestion notebooks throw a securityexception/whitelist errors for numerous spark. functionsIs there some configuration setting I need to enable to whitelist the spark.* methods/functi...
Hi @Jakub K I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest provid...
Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...
I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.
Hi guys, how are you ?How can I access tables outside the Databricks ? (hive metastore)I have a python script in my local structure but I need to access are tables stored in Databricks (hive metastore) , how ???? Have any idea ?Thank you guys
I am trying to assign my databricks_metastore on terraform and I get the following error back as an output `Error: cannot create metastore assignment: Workspace is not in the same region as metastore. Workspace region: Unknown, Metastore region: us-e...
The error message you received indicates that the Databricks workspace region is different from the region where the metastore is located. The message shows that the workspace region is "Unknown", which means that Databricks is unable to determine th...
I am researching, if databricks support delta sharing with AWS private link?
Yes, Delta Sharing does support AWS PrivateLink. According to the official documentation, using AWS PrivateLink is a recommended way to enable private connectivity between clusters on the data plane and core services on the control plane within the D...
Hi Everyone, I configured my workspace with the unity catalog; however, ever since, I am unable to add users to my workspace. The issue is not related to the process of adding a user, but is related to the added user cannot receive invitation emails ...
Hi @pandas , I faced the similar issue and upon raising a support ticket to Databricks, got to know the root cause (based on the response received). In case your email address has some issues receiving the email when the invite is being sent, the ema...
In which sequence init scripts are getting executed
If I have multiple cluster-scoped init scripts, can I guarantee the order that these scripts are run in? I have to create a folder on the workers and other scripts copy files into that folder.
During UC upgrade, we are required to migrate to account groups from workspace local groups. We are unable to add an account group without first deleting first the workspace local group (as they both have the same name).And, during this process, the ...
