- 527 Views
- 1 replies
- 0 kudos
Accessing unity catalog volumes from a databricks web application
Hello,I am trying to deploy a gradio app (app.py) in databricks, but I am having problem accessing data stored in a volume in unity catalog. It seems like that I cannot access the data using path like "/Volumes/catalog/schema.../my_data", which works...
- 527 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @kktim You're facing a common challenge with Gradio apps in Databricks.The issue is that Gradio apps run in a different execution context than notebooks,so they don't have the same access to Unity Catalog volumes.Here are several approaches to sol...
- 0 kudos
- 4904 Views
- 1 replies
- 0 kudos
Error: cannot import share credential file from implemented delta sharing server in Unity Catalog
We have implemented our own delta sharing server, following the delta sharing protocol. We are able to use the delta-sharing connectors to read shared data from our own server. However, when we tried importing our share credential file in Databricks ...
- 4904 Views
- 1 replies
- 0 kudos
- 0 kudos
Fixed
- 0 kudos
- 3089 Views
- 5 replies
- 2 kudos
Resolved! Accessing Databricks Delta Live Tables (DLT) in MS Fabric with Unity Catalog Integration
Hi Community,I’ve been working on a data pipeline using Databricks Delta Live Tables (DLT) with Unity Catalog. My setup saves data into Azure Data Lake Storage (ADLS) for streaming tables. However, I’ve noticed that Unity Catalog encrypts various com...
- 3089 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi Community,I previously reached out regarding creating shortcuts in Microsoft Fabric for Databricks Delta Live Tables (DLT) managed through Unity Catalog, specifically when the data resides in Azure Data Lake Storage (ADLS) and appears encrypted.Af...
- 2 kudos
- 3048 Views
- 2 replies
- 0 kudos
Delta Sharing - 'No data' in schema
When creating a data share in my Databricks workspace, in the step Add data assets, one of my schemas in Unity Catalog shows 'No data' when expanding. If I expand the same schema in Unity Catalog explorer, it shows lots of tables and all tables conta...
- 3048 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @Anske , This feature is currently in private preview. You should contact your account team to have it enabled in your workspace(s). Requirements Databricks Runtime (DBR) 13.3 or aboveRecipients must use Serverless SQL warehouse to query a shar...
- 0 kudos
- 2628 Views
- 2 replies
- 0 kudos
Naming conventions for delta sharing
Hi All,A question for those using Delta Sharing, how are you defining naming conventions for Shares and Recipient names? What best practices or standards are you following? Thanks, Fatima
- 2628 Views
- 2 replies
- 0 kudos
- 0 kudos
For platform-to-platform environments, I nest all shared tables under a specially named Schema with a prefix of DS-. For example, my schema name could be ds-mfgschema. This is a 'flag' that any tables nested under this schema are being delta shared ...
- 0 kudos
- 823 Views
- 1 replies
- 0 kudos
Permissions needed for creating a new (delta) share
What permissions are actually needed in order to create a delta share?I have read that you either need to be metastore admin, or aUser with delegated permissions or ownership on both the share and the recipient objects ((USE SHARE + SET SHARE PERMISS...
- 823 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Hope the doc link helps: https://docs.databricks.com/en/delta-sharing/create-share.html#requirements Specifically this statement should alleviate your immediate point. Have the USE CATALOG and USE SCHEMA privilege on the catalog and schema that...
- 0 kudos
- 2804 Views
- 0 replies
- 1 kudos
Whitepaper - leverage Databricks to build a robust data governance framework
I am excited to share that I recently published a whitepaper on how to leverage Databricks to build a robust data governance framework. This paper explores key strategies and best practices for implementing a strong governance model using Databricks'...
- 2804 Views
- 0 replies
- 1 kudos
- 2719 Views
- 3 replies
- 0 kudos
Delta Sharing within the same region
Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...
- 2719 Views
- 3 replies
- 0 kudos
- 0 kudos
Do we have any updates on this in terms of how we can share the data between different workspaces part of the same metastore?
- 0 kudos
- 7420 Views
- 7 replies
- 9 kudos
Resolved! Delta sharing without unity catalog
Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?
- 7420 Views
- 7 replies
- 9 kudos
- 9 kudos
Is it possible to receive data in databricks notebook without enabling the unity catalog?
- 9 kudos
- 2823 Views
- 0 replies
- 0 kudos
[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools
Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
- 2823 Views
- 0 replies
- 0 kudos
- 976 Views
- 0 replies
- 0 kudos
Lineage on-premise DB2/LUW or Z/os
We've an on-premises DB2/LUW and Z/Os database and we need to show a lineage of them. Can Unity Catalog or Purview do this? If we've the best, what would it be? Or would working with both be a better option?
- 976 Views
- 0 replies
- 0 kudos
- 3630 Views
- 2 replies
- 0 kudos
list shares in the workspace, include_shared_data bool field not available
To list all the shares in the workspace, the api does not support include_shared_data as supported in get share details. Is there any way we can list the shares with the objects. https://docs.databricks.com/api/azure/workspace/shares/listhttps://doc...
- 3630 Views
- 2 replies
- 0 kudos
- 0 kudos
Might be a problem with your access level. Run as a metastore admin or or as owner of the catalogs. You might see the results.
- 0 kudos
- 7476 Views
- 3 replies
- 1 kudos
Resolved! Can't create unity catalog in azure databricks
   Hello community,i'm trying to create a unity catalog in azure dataricks, but facing the issue, while creating it shows metastore already exist as error but in reality this is the first time i'm creating, in background it created meta store as half...
- 7476 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @venkateshkallam , If you are still facing the issue, please try purging storage & revisions from Databricks Workspace.You can do this by going to Admin Settings --> Storage --> purgeI did it for my workspace where residual files may be causing th...
- 1 kudos
- 2696 Views
- 3 replies
- 5 kudos
Unity Catalog and Delta Sharing Workshop - Register Now! Join us on February 2nd, 2023 as we take Unity Catalog for a spin. Register Here!! Unity Cata...
Unity Catalog and Delta Sharing Workshop - Register Now!Join us on February 2nd, 2023 as we take Unity Catalog for a spin. Register Here!!Unity Catalog provides a unified governance solution for data, analytics and AI on any cloud. With Unity Catalog...
- 2696 Views
- 3 replies
- 5 kudos
- 1775 Views
- 0 replies
- 6 kudos
Your guide to data and AI governance sessions at Data + AI Summit 2022 We are so excited to welcome you to Data + AI Summit this year. This year’s hyb...
Your guide to data and AI governance sessions at Data + AI Summit 2022We are so excited to welcome you to Data + AI Summit this year. This year’s hybrid conference is jam packed with exciting product announcements, live keynotes, breakout sessions wi...
- 1775 Views
- 0 replies
- 6 kudos