cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Shubhanshu
by New Contributor II
  • 2549 Views
  • 1 replies
  • 0 kudos

Unable to create external table

I am trying to create an external table using csv file which is stored in ADLS gen2 My account owner has created a storage credential and an external location I am a databricks user who all privileges on external location when trying to create a tabl...

  • 2549 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Shubhanshu, To overcome the error and create the table, ensure that the client secret token associated with the Azure Active Directory (Azure AD) application service principal is not expired or invalid. Here are the steps you can follow: 1. Open...

  • 0 kudos
kaustubhgupta
by New Contributor II
  • 2537 Views
  • 2 replies
  • 0 kudos

How to setup oauth for Databricks connection in Tableau Server?

We extensively use Databricks (DBX) for creating Tableau visuals. Whenever DBX data sources are published on our self hosted Tableau Server, we have to add the connection creds for the data source. These creds can be both personal email id-password o...

  • 2537 Views
  • 2 replies
  • 0 kudos
Latest Reply
kaustubhgupta
New Contributor II
  • 0 kudos

Thanks for your response. While I understood most of it, I still have some doubts to clear. Therefore explaining it again. Problem: We want users to create data sources using Databricks via their personal credentials in the local env (tableau desktop...

  • 0 kudos
1 More Replies
TonyUK
by New Contributor II
  • 5198 Views
  • 7 replies
  • 4 kudos

Can I delete hive_metastore on a Unity Catalog Workspace?

Hi, I have a new workspace that was converted to be controlled via Unity Catalog.There is not data stored here as this is not in use yet, so I wanted to ask if it was safe to remove this without breaking the workspace?Thank you

  • 5198 Views
  • 7 replies
  • 4 kudos
Latest Reply
JasonThomas
New Contributor III
  • 4 kudos

As things gravitate towards Unity Catalog, it would indeed be nice to have the the ability to completely remove Hive from existing setups.

  • 4 kudos
6 More Replies
Shubhanshu
by New Contributor II
  • 2883 Views
  • 1 replies
  • 0 kudos

Resolved! Error while describing table created in unity catalog

I have created an external table in unity catalog and when describing its data getting the following errororg.apache.hadoop.fs.FileAlreadyExistsException: Operation failed: "The specified path, or an element of the path, exists and its resource type ...

  • 2883 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Shubhanshu , The error message you're seeing is a FileAlreadyExistsException from the Hadoop File System (HDFS). This error typically occurs when there's an attempt to create a file or directory that already exists, and the operation being perfor...

  • 0 kudos
shkelzeen
by New Contributor II
  • 2583 Views
  • 4 replies
  • 0 kudos

Create token for ServicePrincipal using java SDK

Hi TeamI am looking into implementing a functionality which allows me to create a ServicePrincipal and I want to create a personal token for this ServicePrincipal using java sdk. While trying to do this I am getting this error ```com.databricks.sdk.c...

  • 2583 Views
  • 4 replies
  • 0 kudos
Latest Reply
shkelzeen
New Contributor II
  • 0 kudos

Hi Thank you for your response how would the databricks know for which service principal  I want to grant permission?

  • 0 kudos
3 More Replies
sandeephenkel23
by New Contributor II
  • 3105 Views
  • 3 replies
  • 1 kudos

Resolved! SELECT SCHEMA/USE_SCHEMA WHICH IS MOST SUITABLE FOR ACCESS

Hi,As part of the DataGovernance or Authorization topic we are working on automation of the code for granting the access CATALOG LEVEL,SCHEMA LEVEL and TABLE LEVEL in Unity CatalogAs USE CATALOG Provides access at the Catalog level to user/group(whic...

Data Governance
Select Schema and Use_Schema
  • 3105 Views
  • 3 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @sandeephenkel23, Based on the information provided, if you want to grant a user access to only a particular table from a database/schema and not to all the tables, you should use the SELECT privilege on that particular table. Using USE SCHEMA or ...

  • 1 kudos
2 More Replies
cayisi
by New Contributor
  • 2365 Views
  • 1 replies
  • 1 kudos

Resolved! Scope of Databricks Account Admin Permissions within Azure Tenant

We are in the process of integrating the Unity Catalog with the workspaces across our organization. As a preliminary step, we need to designate a Databricks Account Admin.Our Azure tenant encompasses multiple subscriptions, each hosting distinct work...

  • 2365 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @cayisi, The Databricks Account Admin role does not grant authority over individual subscriptions but extends control over all subscriptions within the tenant. This is because the Databricks Account represents a single entity that can include mult...

  • 1 kudos
drii_cavalcanti
by New Contributor III
  • 3044 Views
  • 2 replies
  • 2 kudos

Resolved! Privilege Issue When Running Delta Table SaveAsTable Command in Databricks Runtime 10.4

I am attempting to execute the following command from a notebook on a runtime 10.4 cluster, but I'm encountering an error: "current user does not have privilege USAGE on Catalog".To provide some context, I am using DBR 10.4 specifically because I nee...

Data Governance
cluster
driver
permission
Unity Catalog
  • 3044 Views
  • 2 replies
  • 2 kudos
Latest Reply
Kaniz
Community Manager
  • 2 kudos

Hi @drii_cavalcanti, The error you're encountering is related to the new USAGE privilege that is enforced on Databricks clusters running Databricks Runtime 7.3 LTS and above. This privilege is required to access an object in the database. To resolve ...

  • 2 kudos
1 More Replies
drii_cavalcanti
by New Contributor III
  • 1636 Views
  • 2 replies
  • 0 kudos

Restoring delta tables from an old metastore to the new one.

Hi everyone,Just wondering if I copy the catalog folders (under the metastore storage) to a different s3 bucket, once I have a new metastore with a new ID I can restore the tables as they were <catalog_name>.<schema_name>.<table_name> into the new me...

Data Governance
metastore
region
  • 1636 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @drii_cavalcanti, copying the catalog folders to a different S3 bucket will not restore the tables in the new metastore. The COPY INTO command loads data from a source (like an S3 bucket or ADLS Gen2 container) into a table in a Databricks workspa...

  • 0 kudos
1 More Replies
Jas
by New Contributor II
  • 1838 Views
  • 2 replies
  • 2 kudos

For Unity Catalog can we sync 2 Metastores which are in different regions?

In our Production tenant we have majority of our workspaces in the North Europe region. We have disaster recovery set up and these workspaces are in West Europe, so will require 2 MetastoresIf Unity Catalog was to get implemented, is there a way to s...

  • 1838 Views
  • 2 replies
  • 2 kudos
Latest Reply
Jas
New Contributor II
  • 2 kudos

Thank you Kaniz - I **bleep** relay this information to my team and reach out if we have any issues when implementing. 

  • 2 kudos
1 More Replies
LukaszJ
by Contributor III
  • 7980 Views
  • 12 replies
  • 12 kudos

Resolved! Databricks SQL View with table access control

Hello,I want to grant 'select' option on some columns in my table.So i created view, and now people can access my view but cannot access the table.However, they cannot do 'select' on the view, because they do not have privileges to the table.What can...

  • 7980 Views
  • 12 replies
  • 12 kudos
Latest Reply
LukaszJ
Contributor III
  • 12 kudos

To sum up,It is not possible to create a view based on a table that someone does not have permission to.It's a pity, because this option would be very useful to limit access to batch-fed tables.Thanks all for the help and your time!Regards,Łukasz

  • 12 kudos
11 More Replies
mathiaskvist
by New Contributor III
  • 1266 Views
  • 2 replies
  • 1 kudos

Provisioning Unity Metastore for each environment using Terraform

HiUnity Metastore can currently only be provisioned once for each Azure region. I have three environments in Azure each consisting of a separate Subscription and Resource Group (RG). Each RG contains a Databricks Workspace and a Storage Account holdi...

  • 1266 Views
  • 2 replies
  • 1 kudos
Latest Reply
Corbin
New Contributor III
  • 1 kudos

Ask and ye shall receive: https://github.com/databricks/terraform-provider-databricks/releases/tag/v1.24.0They've implemented account-level UC API in terraform now!

  • 1 kudos
1 More Replies
RafaelGomez61
by New Contributor
  • 2679 Views
  • 3 replies
  • 0 kudos

SQL Warehouse Cluster - How to configure External Hive Meta Store

In my Databricks regular Clusters, Our clusters are configured to an External Hive Meta Store (Azure SQL Server). I am able to set the External Hive configuration in the Advanced options Spark config setting within the cluster setting. In our setting...

  • 2679 Views
  • 3 replies
  • 0 kudos
Latest Reply
judyy
New Contributor II
  • 0 kudos

@RafaelGomez61 I have the some problem and after some exploring, I've configured it and also wrote a blog for the whole steps. You can have a look here: https://medium.com/@judy3.yang/how-to-configure-external-hive-meta-store-for-databricks-sql-wareh...

  • 0 kudos
2 More Replies
jakubk
by Contributor
  • 7789 Views
  • 7 replies
  • 3 kudos

Unity Catalog - spark.* functions throwing Py4JSecurityException - org.apache.spark.sql.internal.CatalogImpl.currentCatalog() is not whitelisted on class class org.apache.spark.sql.internal.CatalogImpl

I'm looking to migrate onto unity catalog but a number of my data ingestion notebooks throw a securityexception/whitelist errors for numerous spark. functionsIs there some configuration setting I need to enable to whitelist the spark.* methods/functi...

  • 7789 Views
  • 7 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Jakub K​ I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest provid...

  • 3 kudos
6 More Replies
Marra
by New Contributor III
  • 9104 Views
  • 12 replies
  • 18 kudos

Resolved! Unity Catalog - multiple metastore in same region

Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...

  • 9104 Views
  • 12 replies
  • 18 kudos
Latest Reply
AdamMcGuinness
New Contributor III
  • 18 kudos

I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.

  • 18 kudos
11 More Replies
Labels