- 333 Views
- 0 replies
- 1 kudos
unity catalog vs purview
What is the vision of uc and purview , on government
- 333 Views
- 0 replies
- 1 kudos
Forum Posts
- 212 Views
- 0 replies
- 0 kudos
Data governance for multi cloud and hybrid environments
What best practices Can I find the DB governance solution to control costs across different cloud providers an on prem environments?
- 212 Views
- 0 replies
- 0 kudos
- 322 Views
- 1 replies
- 1 kudos
Real time streaming and batch unification
Hello,Will Unity catalog work with a mix of streaming and batch tables?
- 322 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @BankBricks,Unity Catalog supports structured streaming as well:https://docs.databricks.com/structured-streaming/unity-catalog.htmlFundamentally you have the same availability of features as with your standard hive structure within databricks - bu...
- 1 kudos
- 191 Views
- 0 replies
- 0 kudos
DAIS 2023
Day 2 of the DAIS 2023: Intro to Untity Catalog and how to use it to ensure data governance on a multi region and even multi cloud level!
- 191 Views
- 0 replies
- 0 kudos
- 306 Views
- 0 replies
- 0 kudos
Databricks Data+AI Summit 2023
Having a great start to the Data+AI Summit 2023. Especially interested to deep dive into the Unity Catalog and Data governance sessions. Excited at the prospect of Databricks providing a one stop shop for all Data engineering and Data Science require...
- 306 Views
- 0 replies
- 0 kudos
- 1028 Views
- 2 replies
- 1 kudos
Resolved! Not able to get json response for "/api/2.0/accounts/{account_id}/metastores" endpoint.
Hi ,I am trying to get list of all the metastores associated with an accountId. For this I am using the below REST API to get data:accountId = json.loads(dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson())["tags"]["accountId"]...
- 1028 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Apparently, it is working if I add the header `X-Databricks-Account-Console-API-Version` with value `2.0` to the call
- 1 kudos
- 615 Views
- 2 replies
- 0 kudos
Not able to signup in partner academy.
Hi thereI have used my company email to register an account for customer-academy.databricks.com a while back.Now what I need to do is create an account with partner-academy.databricks.com using my company email too.However when I register at partner-...
- 615 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Samidha Sahu​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 0 kudos
- 5893 Views
- 15 replies
- 22 kudos
How to resolve problem with upgrading external table to Unity Catalog?
I have a problem with upgrading table to Unity Catalog, I got the error:summary:Error in SQL statement:AnalysisException:org.apache.hadoop.hive.ql.metadata.HiveException:Unable to fetch table calexception. Exception thrown when executing query :SELEC...
- 5893 Views
- 15 replies
- 22 kudos
Latest Reply
- 22 kudos
Hi Vidula,Unfortunately none of the answers answered my question.
- 22 kudos
- 2707 Views
- 4 replies
- 5 kudos
Resolved! Unity Catalog meta store renaming
Hi guys, new to we have a unity catalog setup already supporting 4 of our workspaces and we would like to rename the metastore. What I would like to confirm is whether or not would I require any configurational or code changes after renaming?
- 2707 Views
- 4 replies
- 5 kudos
Latest Reply
- 5 kudos
Hi @Syed Ismail​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
- 5 kudos
- 5073 Views
- 6 replies
- 3 kudos
Resolved! Unable to query Unity Catalog tables from notebooks.
In my workspace, I'm able to see the unity catalogs my team has created. I'm able to see the schemas and even query data in there and create views using the SQL Editor.When I go to write the same sql queries from a notebook using spark.sql or %sql I ...
- 5073 Views
- 6 replies
- 3 kudos
Latest Reply
- 3 kudos
Hi @Ani Madurkar​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 3 kudos
- 1270 Views
- 2 replies
- 2 kudos
Resolved! Turn on UDFs in Databricks SQL feature
Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...
- 1270 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.
- 2 kudos
- 2444 Views
- 3 replies
- 2 kudos
Resolved! Databricks-connect 11.3 works with Unity Catalog ?
Databricks-connect 11.3 works for unity catalog enabled cluster or not ? I am trying to utilize the databricks-connect in Azure DevOps pipeline using Microsoft hosted agent. But getting the below error when running the databricks-connect test command...
- 2444 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @Rey Jhon​ Sadly, databricks-connect for DBR versions < 13 does not support UC, as outlined in the limitations section: https://docs.databricks.com/dev-tools/databricks-connect-legacy.html#limitations.To use UC, we recommend using DBR version >= 1...
- 2 kudos
- 1444 Views
- 2 replies
- 5 kudos
Unity Catalog location with multiple workspaces and resource groups
We're planning on adding additional workspaces in different Azure resource groups to separate lines of business with the goal of Unity Catalog spanning these workspaces. Each Resource Group will contain a workspace and a data lake. When it comes to U...
- 1444 Views
- 2 replies
- 5 kudos
Latest Reply
- 5 kudos
We've done similar on AWS, If this is regarding setting up backend storage for the metastore it can have a separate one (Ideally it should). Each catalog for each business unit/ workspace can have its own backend data lake too. This one would overrid...
- 5 kudos
- 681 Views
- 2 replies
- 5 kudos
How to prevent escaping tables updated infrequently from the Unity Catalog Data Lineage?
Using Unity Catalog as a unified metastore for Databricks we are able to track the data lineage of tables. The lineage is going to be maintained for 30 days - this is described in the official documentation: - Because lineage is computed on a 30-day ...
- 681 Views
- 2 replies
- 5 kudos
Latest Reply
- 5 kudos
@Natalia Lebedeva​ did you discover any other possible workaround?
- 5 kudos
- 794 Views
- 2 replies
- 0 kudos
Poll: Unity Catalog Usage and Experience
Hello Databricks Community!We hope you have a great time exploring and learning within our community. We'd like to gather your feedback and insights on the Unity Catalog through a quick poll. Your input will help us understand our community's level o...
- 794 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Kaniz,appreciate if Databricks could release a Unity Catalog Upgrade/Migration testing strategy guidance for customers/partners, especially for customers with complex environments. I am willing to offer the outline of such a guidance.
- 0 kudos
