cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MadelynM
by Databricks Employee
  • 1093 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools

Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...

Screenshot 2024-07-03 at 9.27.29 AM.png
  • 1093 Views
  • 0 replies
  • 0 kudos
Edel
by New Contributor II
  • 712 Views
  • 0 replies
  • 0 kudos

Databricks keynote

Excited to hear all the new innovations from Databricks on Unity Catalog to improve Data Governance like  Federation . The possibility to include external data sources is very powerful. Looking forward to see other solutions included like Oracle. 

  • 712 Views
  • 0 replies
  • 0 kudos
Matan
by New Contributor
  • 677 Views
  • 0 replies
  • 0 kudos

DAIS 2023

Loving the conference! Really enjoyed the keynote and the expo!

  • 677 Views
  • 0 replies
  • 0 kudos
BankBricks
by New Contributor
  • 1140 Views
  • 1 replies
  • 1 kudos

Real time streaming and batch unification

Hello,Will Unity catalog work with a mix of streaming and batch tables?

  • 1140 Views
  • 1 replies
  • 1 kudos
Latest Reply
Jath
New Contributor II
  • 1 kudos

Hi @BankBricks,Unity Catalog supports structured streaming as well:https://docs.databricks.com/structured-streaming/unity-catalog.htmlFundamentally you have the same availability of features as with your standard hive structure within databricks - bu...

  • 1 kudos
Schwebekopfdr
by New Contributor
  • 426 Views
  • 0 replies
  • 0 kudos

DAIS 2023

Day 2 of the DAIS 2023: Intro to Untity Catalog and how to use it to ensure data governance on a multi region and even multi cloud level!

  • 426 Views
  • 0 replies
  • 0 kudos
Yash_S
by New Contributor
  • 675 Views
  • 0 replies
  • 0 kudos

Databricks Data+AI Summit 2023

Having a great start to the Data+AI Summit 2023. Especially interested to deep dive into the Unity Catalog and Data governance sessions. Excited at the prospect of Databricks providing a one stop shop for all Data engineering and Data Science require...

  • 675 Views
  • 0 replies
  • 0 kudos
nikhilkumawat
by New Contributor III
  • 2613 Views
  • 2 replies
  • 1 kudos

Resolved! Not able to get json response for "/api/2.0/accounts/{account_id}/metastores" endpoint.

Hi ,I am trying to get list of all the metastores associated with an accountId. For this I am using the below REST API to get data:accountId = json.loads(dbutils.notebook.entry_point.getDbutils().notebook().getContext().toJson())["tags"]["accountId"]...

metastore_response
  • 2613 Views
  • 2 replies
  • 1 kudos
Latest Reply
ruben1
New Contributor III
  • 1 kudos

Apparently, it is working if I add the header `X-Databricks-Account-Console-API-Version` with value `2.0` to the call

  • 1 kudos
1 More Replies
Sami1234
by New Contributor
  • 1637 Views
  • 2 replies
  • 0 kudos

Not able to signup in partner academy.

Hi thereI have used my company email to register an account for customer-academy.databricks.com a while back.Now what I need to do is create an account with partner-academy.databricks.com using my company email too.However when I register at partner-...

  • 1637 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Samidha Sahu​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...

  • 0 kudos
1 More Replies
vexor
by Contributor
  • 16011 Views
  • 15 replies
  • 22 kudos

How to resolve problem with upgrading external table to Unity Catalog?

I have a problem with upgrading table to Unity Catalog, I got the error:summary:Error in SQL statement:AnalysisException:org.apache.hadoop.hive.ql.metadata.HiveException:Unable to fetch table calexception. Exception thrown when executing query :SELEC...

  • 16011 Views
  • 15 replies
  • 22 kudos
Latest Reply
vexor
Contributor
  • 22 kudos

Hi Vidula,Unfortunately none of the answers answered my question.

  • 22 kudos
14 More Replies
Ismail1
by New Contributor III
  • 13253 Views
  • 4 replies
  • 5 kudos

Resolved! Unity Catalog meta store renaming

Hi guys, new to we have a unity catalog setup already supporting 4 of our workspaces and we would like to rename the metastore. What I would like to confirm is whether or not would I require any configurational or code changes after renaming?

  • 13253 Views
  • 4 replies
  • 5 kudos
Latest Reply
Anonymous
Not applicable
  • 5 kudos

Hi @Syed Ismail​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...

  • 5 kudos
3 More Replies
DAUR
by New Contributor
  • 4337 Views
  • 2 replies
  • 2 kudos

Resolved! Turn on UDFs in Databricks SQL feature

Hello,Im using Unity Catalog managed tables and Unity Catalog DLTs. I urgently need to use a UDF in DBSQL because pySpark UDFs dont work in UC. I found this way to create a SQL function and use python language inside:CREATE FUNCTION redact(a STRING) ...

  • 4337 Views
  • 2 replies
  • 2 kudos
Latest Reply
youssefmrini
Databricks Employee
  • 2 kudos

It will be available soon in public preview. You will need to have a Pro SQL Warehouse or a Serverless SQL Warehouse to use Python UDF in Databricks SQL.

  • 2 kudos
1 More Replies
DataEngineer92
by New Contributor II
  • 5264 Views
  • 4 replies
  • 2 kudos

Resolved! Databricks-connect 11.3 works with Unity Catalog ?

Databricks-connect 11.3 works for unity catalog enabled cluster or not ? I am trying to utilize the databricks-connect in Azure DevOps pipeline using Microsoft hosted agent. But getting the below error when running the databricks-connect test command...

  • 5264 Views
  • 4 replies
  • 2 kudos
Latest Reply
bastih
Databricks Employee
  • 2 kudos

Hi @Rey Jhon​ Sadly, databricks-connect for DBR versions < 13 does not support UC, as outlined in the limitations section: https://docs.databricks.com/dev-tools/databricks-connect-legacy.html#limitations.To use UC, we recommend using DBR version >= 1...

  • 2 kudos
3 More Replies
fred41
by New Contributor III
  • 3184 Views
  • 2 replies
  • 5 kudos

Unity Catalog location with multiple workspaces and resource groups

We're planning on adding additional workspaces in different Azure resource groups to separate lines of business with the goal of Unity Catalog spanning these workspaces. Each Resource Group will contain a workspace and a data lake. When it comes to U...

  • 3184 Views
  • 2 replies
  • 5 kudos
Latest Reply
Ismail1
New Contributor III
  • 5 kudos

We've done similar on AWS, If this is regarding setting up backend storage for the metastore it can have a separate one (Ideally it should). Each catalog for each business unit/ workspace can have its own backend data lake too. This one would overrid...

  • 5 kudos
1 More Replies
ntlbdv
by New Contributor III
  • 1549 Views
  • 2 replies
  • 5 kudos

How to prevent escaping tables updated infrequently from the Unity Catalog Data Lineage?

Using Unity Catalog as a unified metastore for Databricks we are able to track the data lineage of tables. The lineage is going to be maintained for 30 days - this is described in the official documentation: - Because lineage is computed on a 30-day ...

  • 1549 Views
  • 2 replies
  • 5 kudos
Latest Reply
NOOR_BASHASHAIK
Contributor
  • 5 kudos

@Natalia Lebedeva​ did you discover any other possible workaround?

  • 5 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels