cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

LukaszJ
by Contributor III
  • 9755 Views
  • 12 replies
  • 12 kudos

Resolved! Databricks SQL View with table access control

Hello,I want to grant 'select' option on some columns in my table.So i created view, and now people can access my view but cannot access the table.However, they cannot do 'select' on the view, because they do not have privileges to the table.What can...

  • 9755 Views
  • 12 replies
  • 12 kudos
Latest Reply
LukaszJ
Contributor III
  • 12 kudos

To sum up,It is not possible to create a view based on a table that someone does not have permission to.It's a pity, because this option would be very useful to limit access to batch-fed tables.Thanks all for the help and your time!Regards,Łukasz

  • 12 kudos
11 More Replies
mathiaskvist
by New Contributor III
  • 1564 Views
  • 2 replies
  • 1 kudos

Provisioning Unity Metastore for each environment using Terraform

HiUnity Metastore can currently only be provisioned once for each Azure region. I have three environments in Azure each consisting of a separate Subscription and Resource Group (RG). Each RG contains a Databricks Workspace and a Storage Account holdi...

  • 1564 Views
  • 2 replies
  • 1 kudos
Latest Reply
Corbin
New Contributor III
  • 1 kudos

Ask and ye shall receive: https://github.com/databricks/terraform-provider-databricks/releases/tag/v1.24.0They've implemented account-level UC API in terraform now!

  • 1 kudos
1 More Replies
RafaelGomez61
by New Contributor
  • 3441 Views
  • 3 replies
  • 0 kudos

SQL Warehouse Cluster - How to configure External Hive Meta Store

In my Databricks regular Clusters, Our clusters are configured to an External Hive Meta Store (Azure SQL Server). I am able to set the External Hive configuration in the Advanced options Spark config setting within the cluster setting. In our setting...

  • 3441 Views
  • 3 replies
  • 0 kudos
Latest Reply
judyy
New Contributor III
  • 0 kudos

@RafaelGomez61 I have the some problem and after some exploring, I've configured it and also wrote a blog for the whole steps. You can have a look here: https://medium.com/@judy3.yang/how-to-configure-external-hive-meta-store-for-databricks-sql-wareh...

  • 0 kudos
2 More Replies
jakubk
by Contributor
  • 10527 Views
  • 7 replies
  • 4 kudos

Unity Catalog - spark.* functions throwing Py4JSecurityException - org.apache.spark.sql.internal.CatalogImpl.currentCatalog() is not whitelisted on class class org.apache.spark.sql.internal.CatalogImpl

I'm looking to migrate onto unity catalog but a number of my data ingestion notebooks throw a securityexception/whitelist errors for numerous spark. functionsIs there some configuration setting I need to enable to whitelist the spark.* methods/functi...

  • 10527 Views
  • 7 replies
  • 4 kudos
Latest Reply
Anonymous
Not applicable
  • 4 kudos

Hi @Jakub K​ I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest provid...

  • 4 kudos
6 More Replies
Marra
by New Contributor III
  • 12650 Views
  • 12 replies
  • 18 kudos

Resolved! Unity Catalog - multiple metastore in same region

Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...

  • 12650 Views
  • 12 replies
  • 18 kudos
Latest Reply
AdamMcGuinness
New Contributor III
  • 18 kudos

I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.

  • 18 kudos
11 More Replies
Alex006
by Contributor
  • 7719 Views
  • 11 replies
  • 11 kudos

Resolved! Metastore creation - Azure Databricks - Access validation failed

Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...

Access validation failed when trying to create a metastore Role assignment to azure databricks connector in the storage account
  • 7719 Views
  • 11 replies
  • 11 kudos
Latest Reply
abarber
New Contributor II
  • 11 kudos

I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.

  • 11 kudos
10 More Replies
William_Scardua
by Valued Contributor
  • 4660 Views
  • 5 replies
  • 4 kudos

Resolved! Access table outside Databricks (hive metastore)

Hi guys, how are you ?How can I access tables outside the Databricks ? (hive metastore)I have a python script in my local structure but I need to access are tables stored in Databricks (hive metastore) , how ???? Have any idea ?Thank you guys

  • 4660 Views
  • 5 replies
  • 4 kudos
Latest Reply
pokharatours
New Contributor II
  • 4 kudos

Thanks, Pokhara Tour

  • 4 kudos
4 More Replies
Awakz
by New Contributor II
  • 3520 Views
  • 4 replies
  • 3 kudos

Having an issue assigning databricks_metastore with terraform provider

I am trying to assign my databricks_metastore on terraform and I get the following error back as an output `Error: cannot create metastore assignment: Workspace is not in the same region as metastore. Workspace region: Unknown, Metastore region: us-e...

  • 3520 Views
  • 4 replies
  • 3 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 3 kudos

The error message you received indicates that the Databricks workspace region is different from the region where the metastore is located. The message shows that the workspace region is "Unknown", which means that Databricks is unable to determine th...

  • 3 kudos
3 More Replies
Tealium
by New Contributor
  • 970 Views
  • 2 replies
  • 0 kudos

Is delta sharing supported on aws Private link to non databricks customers?

I am researching, if databricks support delta sharing with AWS private link?

  • 970 Views
  • 2 replies
  • 0 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 0 kudos

Yes, Delta Sharing does support AWS PrivateLink. According to the official documentation, using AWS PrivateLink is a recommended way to enable private connectivity between clusters on the data plane and core services on the control plane within the D...

  • 0 kudos
1 More Replies
pandas
by New Contributor II
  • 2661 Views
  • 6 replies
  • 0 kudos

The invited user cannot receive an invitation email from Databricks

Hi Everyone, I configured my workspace with the unity catalog; however, ever since, I am unable to add users to my workspace. The issue is not related to the process of adding a user, but is related to the added user cannot receive invitation emails ...

  • 2661 Views
  • 6 replies
  • 0 kudos
Latest Reply
Kratik
New Contributor III
  • 0 kudos

Hi @pandas , I faced the similar issue and upon raising a support ticket to Databricks, got to know the root cause (based on the response received). In case your email address has some issues receiving the email when the invite is being sent, the ema...

  • 0 kudos
5 More Replies
User16826994223
by Honored Contributor III
  • 1412 Views
  • 2 replies
  • 1 kudos

Resolved! Init script execution order

In which sequence init scripts are getting executed

  • 1412 Views
  • 2 replies
  • 1 kudos
Latest Reply
Mike2
New Contributor II
  • 1 kudos

If I have multiple cluster-scoped init scripts, can I guarantee the order that these scripts are run in?  I have to create a folder on the workers and other scripts copy files into that folder. 

  • 1 kudos
1 More Replies
NOOR_BASHASHAIK
by Contributor
  • 1428 Views
  • 3 replies
  • 0 kudos

Unity Catalog Upgrade - Maximizing System Availability - Ideas

During UC upgrade, we are required to migrate to account groups from workspace local groups. We are unable to add an account group without first deleting first the workspace local group (as they both have the same name).And, during this process, the ...

  • 1428 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @NOOR_BASHASHAIK ,   Suppose you are enabling identity federation on an existing workspace. In that case, you can use account groups and workspace-local groups side-by-side. Still, it is recommended to turn workspace-local groups into account grou...

  • 0 kudos
2 More Replies
deep_thought
by New Contributor III
  • 12332 Views
  • 7 replies
  • 8 kudos

Resolved! Datagrip unity catalog support

Is anyone able to see unity catalog objects in Datagrip? I can only view hive_metastore objects.Nothing mentioned here https://docs.databricks.com/dev-tools/datagrip.html

  • 12332 Views
  • 7 replies
  • 8 kudos
Latest Reply
fferrao
New Contributor III
  • 8 kudos

Working with someone else together we have been able to get unity catalog objects in Datagrip. I am only able to connect to one catalog database at a time using separate Data Sources as I have not been successful loading them all from one.Under Data ...

  • 8 kudos
6 More Replies
JameDavi_51481
by New Contributor III
  • 2956 Views
  • 1 replies
  • 0 kudos

using the SYNC TABLE command with AWS Glue tables

According to the docs, we should be able to use SYNC TABLE to 'upgrade' a table from a Hive metastore to Unity Catalog. We are using AWS Glue as our Hive Metastore, but tables created in Glue do not seem to be set up in a format that Databricks likes...

  • 2956 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @JameDavi_51481, Unity Catalog does not support tables created in AWS Glue using Hive SerDe and cannot be upgraded using the SYNC command. The recommended solution is to change the tables into Delta format and then issue the SYNC command to upgrad...

  • 0 kudos
Pat
by Honored Contributor III
  • 8543 Views
  • 4 replies
  • 17 kudos

Error: cannot create metastore data access: No metastore assigned for the current workspace.

and situation?I am currently trying to came up with the way how to deploy Databricks with Terraform in multi-region, multi-tenant environment. I am not talking about simple cases like this (https://docs.databricks.com/data-governance/unity-catalo...

  • 8543 Views
  • 4 replies
  • 17 kudos
Latest Reply
pwc-aiq
New Contributor II
  • 17 kudos

Hi, I'm experiencing a similar issue. I filed an Issue on Github here. 

  • 17 kudos
3 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels