Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
Due to some problems, I need to set Py4JSecurity to false, however I get the following message: "spark.databricks.pyspark.enablePy4JSecurity is not allowed when choosing an access mode"My cluster is in Shared access mode and a runtime version 12.1 (i...
Hi, Could you please test it on a standard standalone cluster/single user cluster and confirm? The error is occurring because enabling the security may break user isolation. Please let us know if this helps. Also please tag @Debayan​ with your next r...
What is the most cost-effective way to sync delta tables across workspaces? I'd like to sync a production table from the production workspace to a staging workspace for testing. It doesn't have to be in real-time, on a daily basis is acceptable. We a...
Hi @Liz Zhang​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
maybe this is a bug in the unity catalog as the error happens multiple times when a table becomes inaccessibleerror: Request failed with status code 404try to drop the table error: NoSuchTableException: [TABLE_OR_VIEW_NOT_FOUND] try to replace the ta...
the error disappeared now after a few months.It could behappens when there is a lot of schema change on db during the initial project stage.there may be some temp security issuesmay be databricks fixed in the back end appears less issue when schema r...
Hi,I want to configure Unity Catalog and one step is creating a metastore in the region where I create databricks workspace (I am on Azure). I created a workspace with a premium pricing tier and I am the admin. Following the documentation, I should g...
Hi @Mohammad Saber​ Glad to hear that!Please mark the answer as best. It will be highly grateful.Thanks
Hello All, I am using Premium subscription and have admin access in workspace, however I am not able to get the option to create metastore for unity catalog
Hi @Vivek Singh Banafar​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your f...
Hello,I'm confused about documentation on privilege types when using HMS.The following page is supposed to talk about HMShttps://docs.databricks.com/sql/language-manual/sql-ref-privileges-hms.htmlbut it also mentions READ FILESQuery files directly us...
Hi @Chris Nawara​ I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest ...
we are using data bricks provided default workspace configuration in GCP. we have created 3 gcs buckets and we want to access them by using service principal name through data bricks all-purpose cluster. when we add service principal name in cluster,...
@Kaniz Fatma​ I am trying to raise support ticket, but it is showing admin permission Issue. I am account owner and admin, but still i am unable raise support ticket. whereas if i raise through email it is going to normal priority and not receiving a...
We are excited to announce the Security Analysis Tool (SAT) for AWS! What is the Security Analysis Tool (SAT)?SAT helps customers monitor the security health of customer account workspaces over time by comparing workspace configurations against speci...
Announcing Terraform support for setting up the Security Analysis Tool (SAT). Now setting up SAT is super easy on all clouds: https://github.com/databricks-industry-solutions/security-analysis-tool/tree/main/terraform
Hi All,I am trying to manage access to objects created in a Unity Catalog.I want the owner/creator of the object(me) to not have access to the object and only the specified users/groups to be able to select/perform other actions on the objects.But th...
Hi @Akash Sivadas​ ,I think you can do it by data explorer tab.Please refer below blog for the same-Manage Unity Catalog permissions in Data Explorer | Databricks on AWS
HiGetting the error message as below: when following the tutorial:Get started using Unity Catalog - Azure Databricks | Microsoft Learnin the section of "Create your first metastore and attach a workspace" with both storage and connector information f...
This is a bug, thanks for reporting it! Databricks engineers would address this soon.
HelloI have created the metastore, linked it to the worskpace, my account is admin in Azure and Databricks, followed these instructions:link1link2link3But when I try to create a table (granting privileges to use catalog, create schemas and create tab...
I finally made it work.It seems that although after configuring the metastore to work with a manged identity, the metastore must be upgraded with this guide.
Hi,we are creating an external table in the Azure databricks but facing this error:org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.meta...
@Priyanka Biswas​ is there a place where we can have updates on metastore upgrades or control plane individual components. usually we can only see control plane region wide status
In my org we've got workspaces with a mixture of SCIM-provisioned and non-SCIM groups. These are all 'workspace local' groups. My identity provider is AAD.I've created a new workspace and want users in this workspace to be provided access only via ac...
Hi, Please refer to https://learn.microsoft.com/en-us/azure/databricks/administration-guide/users-groups/users and https://learn.microsoft.com/en-us/azure/databricks/administration-guide/users-groups/groups. Also, please note if you already have SCIM...
Hello,I started testing Unity catalog and was surprised by the following mention in the documentation about shared clusters not supporting third-party1 libraries. Nevertheless, I tried doing imports and using pip install and both were working correct...
Hi Aviral-Bhardwaj-ji, I have seen a couple of mentions about Whitelisting of libraries on the Account but have struggled to find any detail about how to actually do this. Like RickDB (OP) I have been exploring the idea of 'whitelisting' libraries on...
I have created a cluster which has advance options set for external hive metastore. I created a mount using sp for my data lake and then create a table using the mount . As per my knowledge the metadata of the table will be stored in sql db but i wou...
Hi @Vishal Gupta​ when we create a mount we store the mount info in a file in the DBFS root bucket.
