cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

nikhilkumawat
by New Contributor III
  • 1773 Views
  • 2 replies
  • 1 kudos

Resolved! Not able to get json response for "/api/2.0/accounts/{account_id}/metastores" endpoint.

Hi ,I am trying to get list of all the metastores associated with an accountId. For this I am using the below REST API to get data:accountId = json.loads(dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson())["tags"]["accountId"]...

metastore_response
  • 1773 Views
  • 2 replies
  • 1 kudos
Latest Reply
ruben1
New Contributor III
  • 1 kudos

Apparently, it is working if I add the header `X-Databricks-Account-Console-API-Version` with value `2.0` to the call

  • 1 kudos
1 More Replies
Sami1234
by New Contributor
  • 1202 Views
  • 2 replies
  • 0 kudos

Not able to signup in partner academy.

Hi thereI have used my company email to register an account for customer-academy.databricks.com a while back.Now what I need to do is create an account with partner-academy.databricks.com using my company email too.However when I register at partner-...

  • 1202 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Samidha Sahu​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...

  • 0 kudos
1 More Replies
vexor
by Contributor
  • 8305 Views
  • 15 replies
  • 22 kudos

How to resolve problem with upgrading external table to Unity Catalog?

I have a problem with upgrading table to Unity Catalog, I got the error:summary:Error in SQL statement:AnalysisException:org.apache.hadoop.hive.ql.metadata.HiveException:Unable to fetch table calexception. Exception thrown when executing query :SELEC...

  • 8305 Views
  • 15 replies
  • 22 kudos
Latest Reply
vexor
Contributor
  • 22 kudos

Hi Vidula,Unfortunately none of the answers answered my question.

  • 22 kudos
14 More Replies
Ismail1
by New Contributor III
  • 9328 Views
  • 4 replies
  • 5 kudos

Resolved! Unity Catalog meta store renaming

Hi guys, new to we have a unity catalog setup already supporting 4 of our workspaces and we would like to rename the metastore. What I would like to confirm is whether or not would I require any configurational or code changes after renaming?

  • 9328 Views
  • 4 replies
  • 5 kudos
Latest Reply
Anonymous
Not applicable
  • 5 kudos

Hi @Syed Ismail​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 5 kudos
3 More Replies
animadurkar
by New Contributor III
  • 8631 Views
  • 6 replies
  • 3 kudos

Resolved! Unable to query Unity Catalog tables from notebooks.

In my workspace, I'm able to see the unity catalogs my team has created. I'm able to see the schemas and even query data in there and create views using the SQL Editor.When I go to write the same sql queries from a notebook using spark.sql or %sql I ...

  • 8631 Views
  • 6 replies
  • 3 kudos
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Ani Madurkar​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...

  • 3 kudos
5 More Replies
DAUR
by New Contributor
  • 2693 Views
  • 2 replies
  • 2 kudos

Resolved! Turn on UDFs in Databricks SQL feature

Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...

  • 2693 Views
  • 2 replies
  • 2 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 2 kudos

It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.

  • 2 kudos
1 More Replies
DataEngineer92
by New Contributor II
  • 3835 Views
  • 4 replies
  • 2 kudos

Resolved! Databricks-connect 11.3 works with Unity Catalog ?

Databricks-connect 11.3 works for unity catalog enabled cluster or not ? I am trying to utilize the databricks-connect in Azure DevOps pipeline using Microsoft hosted agent. But getting the below error when running the databricks-connect test command...

  • 3835 Views
  • 4 replies
  • 2 kudos
Latest Reply
bastih
New Contributor III
  • 2 kudos

Hi @Rey Jhon​ Sadly, databricks-connect for DBR versions < 13 does not support UC, as outlined in the limitations section: https://docs.databricks.com/dev-tools/databricks-connect-legacy.html#limitations.To use UC, we recommend using DBR version >= 1...

  • 2 kudos
3 More Replies
fred41
by New Contributor III
  • 1966 Views
  • 2 replies
  • 5 kudos

Unity Catalog location with multiple workspaces and resource groups

We're planning on adding additional workspaces in different Azure resource groups to separate lines of business with the goal of Unity Catalog spanning these workspaces. Each Resource Group will contain a workspace and a data lake. When it comes to U...

  • 1966 Views
  • 2 replies
  • 5 kudos
Latest Reply
Ismail1
New Contributor III
  • 5 kudos

We've done similar on AWS, If this is regarding setting up backend storage for the metastore it can have a separate one (Ideally it should). Each catalog for each business unit/ workspace can have its own backend data lake too. This one would overrid...

  • 5 kudos
1 More Replies
ntlbdv
by New Contributor III
  • 956 Views
  • 2 replies
  • 5 kudos

How to prevent escaping tables updated infrequently from the Unity Catalog Data Lineage?

Using Unity Catalog as a unified metastore for Databricks we are able to track the data lineage of tables. The lineage is going to be maintained for 30 days - this is described in the official documentation: - Because lineage is computed on a 30-day ...

  • 956 Views
  • 2 replies
  • 5 kudos
Latest Reply
NOOR_BASHASHAIK
Contributor
  • 5 kudos

@Natalia Lebedeva​ did you discover any other possible workaround?

  • 5 kudos
1 More Replies
Kaniz_Fatma
by Community Manager
  • 1500 Views
  • 2 replies
  • 0 kudos

Poll: Unity Catalog Usage and Experience

Hello Databricks Community!We hope you have a great time exploring and learning within our community. We'd like to gather your feedback and insights on the Unity Catalog through a quick poll. Your input will help us understand our community's level o...

  • 1500 Views
  • 2 replies
  • 0 kudos
Latest Reply
NOOR_BASHASHAIK
Contributor
  • 0 kudos

Hi Kaniz,appreciate if Databricks could release a Unity Catalog Upgrade/Migration testing strategy guidance for customers/partners, especially for customers with complex environments. I am willing to offer the outline of such a guidance.

  • 0 kudos
1 More Replies
issibra
by New Contributor III
  • 2320 Views
  • 1 replies
  • 1 kudos

Resolved! Permission to view the tables within customers

In databricks course V3 Unity catalog session I could not understand the answer of this question, can someone please enlighten me ? A senior data engineer with workspace identity privileges has created the schema customers within a Unity Catalog name...

  • 2320 Views
  • 1 replies
  • 1 kudos
Latest Reply
issibra
New Contributor III
  • 1 kudos

The anwser for this question is mentionned here https://community.databricks.com/s/question/0D58Y0000ACa06GSQR/is-there-any-hierarchy-within-schema-permissions

  • 1 kudos
issibra
by New Contributor III
  • 3014 Views
  • 1 replies
  • 2 kudos

Resolved! Question asked in Unity Catalog Databricks course

In Unity catalog part we have this question: A data engineer needs to copy an external table from their default Hive metastore to the Unity Catalog metastore. Which of the following are required to upgrade the table to be managed by Unity Catalog? Se...

  • 3014 Views
  • 1 replies
  • 2 kudos
Latest Reply
issibra
New Contributor III
  • 2 kudos

I think it was a mistake in the mentionned correction in Databricks according to the documentation Upgrade a single external table to Unity CatalogYou can copy an external table from your default Hive metastore to the Unity Catalog metastore using th...

  • 2 kudos
squarshie
by New Contributor III
  • 2862 Views
  • 4 replies
  • 4 kudos

Resolved! Exposing Unity Catalog lineage schema

Have been informed by a vendor we are using for Data Observability that the Unity Catalog lineage can be accessed via the systems schema. This is not enabled by default and we will need to execute a PUT request to the endpoint below. I am unable to f...

  • 2862 Views
  • 4 replies
  • 4 kudos
Latest Reply
Anonymous
Not applicable
  • 4 kudos

Hi @Stephen Quarshie​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...

  • 4 kudos
3 More Replies
Jfoxyyc
by Valued Contributor
  • 2113 Views
  • 2 replies
  • 0 kudos

How to manage dev/prod environments with new unity catalog delta live table integration

Heres my current setup, dev workspace connected to dev keyvault and a prod workspace connected to a prod keyvault. There's a github repo and action syncing the two environments on pull request and all resources created through terraform. This is my n...

  • 2113 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Jordan Fox​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...

  • 0 kudos
1 More Replies
164079
by Contributor II
  • 4863 Views
  • 4 replies
  • 3 kudos

Error : No metastore assigned for the current workspace

Hi team, Is anyone encounter this error?AnalysisException: [RequestId=d065497e-b88c-4687-9687-d7180663e7ba ErrorClass=METASTORE_DOES_NOT_EXIST] No metastore assigned for the current workspaceWe are using Databricks on AWSThanks!

  • 4863 Views
  • 4 replies
  • 3 kudos
Latest Reply
grazie
Contributor
  • 3 kudos

I did test with different access modes and found that it indeed works with "data_security_mode": "LEGACY_SINGLE_USER_STANDARD". I also found clusters with no entry for "data_security_mode" which worked as expected.

  • 3 kudos
3 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels