- 85 Views
- 4 replies
- 1 kudos
Accessing Databricks Delta Live Tables (DLT) in MS Fabric with Unity Catalog Integration
Hi Community,I’ve been working on a data pipeline using Databricks Delta Live Tables (DLT) with Unity Catalog. My setup saves data into Azure Data Lake Storage (ADLS) for streaming tables. However, I’ve noticed that Unity Catalog encrypts various com...
- 85 Views
- 4 replies
- 1 kudos
- 1 kudos
And also, if you get this to work, I'll remind you that the call for presentations for DAIS 2025 is open until Feb 3 and you should submit a talk about connecting Fabric and Databricks because I think a lot of people would want to know that.
- 1 kudos
- 757 Views
- 2 replies
- 0 kudos
Delta Sharing - 'No data' in schema
When creating a data share in my Databricks workspace, in the step Add data assets, one of my schemas in Unity Catalog shows 'No data' when expanding. If I expand the same schema in Unity Catalog explorer, it shows lots of tables and all tables conta...
- 757 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @Anske , This feature is currently in private preview. You should contact your account team to have it enabled in your workspace(s). Requirements Databricks Runtime (DBR) 13.3 or aboveRecipients must use Serverless SQL warehouse to query a shar...
- 0 kudos
- 488 Views
- 2 replies
- 0 kudos
Naming conventions for delta sharing
Hi All,A question for those using Delta Sharing, how are you defining naming conventions for Shares and Recipient names? What best practices or standards are you following? Thanks, Fatima
- 488 Views
- 2 replies
- 0 kudos
- 0 kudos
For platform-to-platform environments, I nest all shared tables under a specially named Schema with a prefix of DS-. For example, my schema name could be ds-mfgschema. This is a 'flag' that any tables nested under this schema are being delta shared ...
- 0 kudos
- 385 Views
- 1 replies
- 0 kudos
Permissions needed for creating a new (delta) share
What permissions are actually needed in order to create a delta share?I have read that you either need to be metastore admin, or aUser with delegated permissions or ownership on both the share and the recipient objects ((USE SHARE + SET SHARE PERMISS...
- 385 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Hope the doc link helps: https://docs.databricks.com/en/delta-sharing/create-share.html#requirements Specifically this statement should alleviate your immediate point. Have the USE CATALOG and USE SCHEMA privilege on the catalog and schema that...
- 0 kudos
- 543 Views
- 0 replies
- 1 kudos
Whitepaper - leverage Databricks to build a robust data governance framework
I am excited to share that I recently published a whitepaper on how to leverage Databricks to build a robust data governance framework. This paper explores key strategies and best practices for implementing a strong governance model using Databricks'...
- 543 Views
- 0 replies
- 1 kudos
- 1951 Views
- 3 replies
- 0 kudos
Delta Sharing within the same region
Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...
- 1951 Views
- 3 replies
- 0 kudos
- 0 kudos
Do we have any updates on this in terms of how we can share the data between different workspaces part of the same metastore?
- 0 kudos
- 3580 Views
- 0 replies
- 0 kudos
Error: cannot import share credential file from implemented delta sharing server in Unity Catalog
We have implemented our own delta sharing server, following the delta sharing protocol. We are able to use the delta-sharing connectors to read shared data from our own server. However, when we tried importing our share credential file in Databricks ...
- 3580 Views
- 0 replies
- 0 kudos
- 5976 Views
- 7 replies
- 9 kudos
Resolved! Delta sharing without unity catalog
Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?
- 5976 Views
- 7 replies
- 9 kudos
- 9 kudos
Is it possible to receive data in databricks notebook without enabling the unity catalog?
- 9 kudos
- 1068 Views
- 0 replies
- 0 kudos
[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools
Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
- 1068 Views
- 0 replies
- 0 kudos
- 779 Views
- 0 replies
- 0 kudos
Lineage on-premise DB2/LUW or Z/os
We've an on-premises DB2/LUW and Z/Os database and we need to show a lineage of them. Can Unity Catalog or Purview do this? If we've the best, what would it be? Or would working with both be a better option?
- 779 Views
- 0 replies
- 0 kudos
- 3269 Views
- 2 replies
- 0 kudos
list shares in the workspace, include_shared_data bool field not available
To list all the shares in the workspace, the api does not support include_shared_data as supported in get share details. Is there any way we can list the shares with the objects. https://docs.databricks.com/api/azure/workspace/shares/listhttps://doc...
- 3269 Views
- 2 replies
- 0 kudos
- 0 kudos
Might be a problem with your access level. Run as a metastore admin or or as owner of the catalogs. You might see the results.
- 0 kudos
- 6446 Views
- 3 replies
- 1 kudos
Resolved! Can't create unity catalog in azure databricks
   Hello community,i'm trying to create a unity catalog in azure dataricks, but facing the issue, while creating it shows metastore already exist as error but in reality this is the first time i'm creating, in background it created meta store as half...
- 6446 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @venkateshkallam , If you are still facing the issue, please try purging storage & revisions from Databricks Workspace.You can do this by going to Admin Settings --> Storage --> purgeI did it for my workspace where residual files may be causing th...
- 1 kudos
- 2121 Views
- 3 replies
- 5 kudos
Unity Catalog and Delta Sharing Workshop - Register Now! Join us on February 2nd, 2023 as we take Unity Catalog for a spin. Register Here!! Unity Cata...
Unity Catalog and Delta Sharing Workshop - Register Now!Join us on February 2nd, 2023 as we take Unity Catalog for a spin. Register Here!!Unity Catalog provides a unified governance solution for data, analytics and AI on any cloud. With Unity Catalog...
- 2121 Views
- 3 replies
- 5 kudos
- 1449 Views
- 0 replies
- 6 kudos
Your guide to data and AI governance sessions at Data + AI Summit 2022 We are so excited to welcome you to Data + AI Summit this year. This year’s hyb...
Your guide to data and AI governance sessions at Data + AI Summit 2022We are so excited to welcome you to Data + AI Summit this year. This year’s hybrid conference is jam packed with exciting product announcements, live keynotes, breakout sessions wi...
- 1449 Views
- 0 replies
- 6 kudos
- 14350 Views
- 8 replies
- 6 kudos
Resolved! Enable Unity Catalog and pre-requisite for Delta Sharing
Hi, I would like to use Delta Sharing but I have not understood how to configure the Delta Sharing Server. Is that fully managed by Databricks ? If so I tried to share a table :%sql create share first_shareand I got the following error message with t...
- 14350 Views
- 8 replies
- 6 kudos
- 6 kudos
Hi @Bertrand BURCKER​ ,This feature is not available yet. If you would like to test it or explore it, then you will need to sign up to get more details once the feature is available. In addition, you could reach out to your account team (in case you...
- 6 kudos