- 183 Views
- 1 replies
- 1 kudos
Unity catalogue sync problem
Hi Everyone ,while I am creating sync table in UC, I got an error and failed . then I am not able to recreate the same table.when I checked the catalogue table name is there but not able to open , and I am querying the same in the notebook .it's givi...
- 183 Views
- 1 replies
- 1 kudos
- 1 kudos
@ajai_duraisamy Here are few checks you can do:1. SHOW TABLES IN <catalog>.<schema> LIKE '<table>'; This command will show if the table exists in UC.2. Make sure your compute is UC‑enabled.If you’re on a cluster/SQL Warehouse without UC enabled (or c...
- 1 kudos
- 1969 Views
- 2 replies
- 1 kudos
Accessing unity catalog volumes from a databricks web application
Hello,I am trying to deploy a gradio app (app.py) in databricks, but I am having problem accessing data stored in a volume in unity catalog. It seems like that I cannot access the data using path like "/Volumes/catalog/schema.../my_data", which works...
- 1969 Views
- 2 replies
- 1 kudos
- 1 kudos
Unlike notebooks, Databricks Apps does not support mounting Unity Catalog volumes and directly reading and writing files. As this code snippet demonstrates, each file needs to be downloaded to the app compute before being able to manipulate it.
- 1 kudos
- 1150 Views
- 2 replies
- 2 kudos
Filtering Partitioned Data in Databricks Delta Share
We have a Delta Share that includes a partitioned table, and we want our recipient to be able to retrieve data only from a specific partition.I reviewed the Delta Sharing server documentation and found that it's possible to use SQL expressions for fi...
- 1150 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Col1ns ,All the things mentioned by @lingareddy_Alva are correct. Some additional things to consider. Check if your implementation of Delta Sharing supports predicate hints. Also, if your server supports them then your predicate should use restri...
- 2 kudos
- 5575 Views
- 1 replies
- 0 kudos
Error: cannot import share credential file from implemented delta sharing server in Unity Catalog
We have implemented our own delta sharing server, following the delta sharing protocol. We are able to use the delta-sharing connectors to read shared data from our own server. However, when we tried importing our share credential file in Databricks ...
- 5575 Views
- 1 replies
- 0 kudos
- 0 kudos
Fixed
- 0 kudos
- 4316 Views
- 5 replies
- 2 kudos
Resolved! Accessing Databricks Delta Live Tables (DLT) in MS Fabric with Unity Catalog Integration
Hi Community,I’ve been working on a data pipeline using Databricks Delta Live Tables (DLT) with Unity Catalog. My setup saves data into Azure Data Lake Storage (ADLS) for streaming tables. However, I’ve noticed that Unity Catalog encrypts various com...
- 4316 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi Community,I previously reached out regarding creating shortcuts in Microsoft Fabric for Databricks Delta Live Tables (DLT) managed through Unity Catalog, specifically when the data resides in Azure Data Lake Storage (ADLS) and appears encrypted.Af...
- 2 kudos
- 4379 Views
- 2 replies
- 0 kudos
Delta Sharing - 'No data' in schema
When creating a data share in my Databricks workspace, in the step Add data assets, one of my schemas in Unity Catalog shows 'No data' when expanding. If I expand the same schema in Unity Catalog explorer, it shows lots of tables and all tables conta...
- 4379 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @Anske , This feature is currently in private preview. You should contact your account team to have it enabled in your workspace(s). Requirements Databricks Runtime (DBR) 13.3 or aboveRecipients must use Serverless SQL warehouse to query a shar...
- 0 kudos
- 3900 Views
- 2 replies
- 0 kudos
Naming conventions for delta sharing
Hi All,A question for those using Delta Sharing, how are you defining naming conventions for Shares and Recipient names? What best practices or standards are you following? Thanks, Fatima
- 3900 Views
- 2 replies
- 0 kudos
- 0 kudos
For platform-to-platform environments, I nest all shared tables under a specially named Schema with a prefix of DS-. For example, my schema name could be ds-mfgschema. This is a 'flag' that any tables nested under this schema are being delta shared ...
- 0 kudos
- 1059 Views
- 1 replies
- 0 kudos
Permissions needed for creating a new (delta) share
What permissions are actually needed in order to create a delta share?I have read that you either need to be metastore admin, or aUser with delegated permissions or ownership on both the share and the recipient objects ((USE SHARE + SET SHARE PERMISS...
- 1059 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Hope the doc link helps: https://docs.databricks.com/en/delta-sharing/create-share.html#requirements Specifically this statement should alleviate your immediate point. Have the USE CATALOG and USE SCHEMA privilege on the catalog and schema that...
- 0 kudos
- 4278 Views
- 0 replies
- 1 kudos
Whitepaper - leverage Databricks to build a robust data governance framework
I am excited to share that I recently published a whitepaper on how to leverage Databricks to build a robust data governance framework. This paper explores key strategies and best practices for implementing a strong governance model using Databricks'...
- 4278 Views
- 0 replies
- 1 kudos
- 3074 Views
- 3 replies
- 0 kudos
Delta Sharing within the same region
Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...
- 3074 Views
- 3 replies
- 0 kudos
- 0 kudos
Do we have any updates on this in terms of how we can share the data between different workspaces part of the same metastore?
- 0 kudos
- 7990 Views
- 7 replies
- 9 kudos
Resolved! Delta sharing without unity catalog
Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?
- 7990 Views
- 7 replies
- 9 kudos
- 9 kudos
Is it possible to receive data in databricks notebook without enabling the unity catalog?
- 9 kudos
- 3316 Views
- 0 replies
- 0 kudos
[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools
Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
- 3316 Views
- 0 replies
- 0 kudos
- 1108 Views
- 0 replies
- 0 kudos
Lineage on-premise DB2/LUW or Z/os
We've an on-premises DB2/LUW and Z/Os database and we need to show a lineage of them. Can Unity Catalog or Purview do this? If we've the best, what would it be? Or would working with both be a better option?
- 1108 Views
- 0 replies
- 0 kudos
- 3836 Views
- 2 replies
- 0 kudos
list shares in the workspace, include_shared_data bool field not available
To list all the shares in the workspace, the api does not support include_shared_data as supported in get share details. Is there any way we can list the shares with the objects. https://docs.databricks.com/api/azure/workspace/shares/listhttps://doc...
- 3836 Views
- 2 replies
- 0 kudos
- 0 kudos
Might be a problem with your access level. Run as a metastore admin or or as owner of the catalogs. You might see the results.
- 0 kudos
- 7920 Views
- 3 replies
- 1 kudos
Resolved! Can't create unity catalog in azure databricks
   Hello community,i'm trying to create a unity catalog in azure dataricks, but facing the issue, while creating it shows metastore already exist as error but in reality this is the first time i'm creating, in background it created meta store as half...
- 7920 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @venkateshkallam , If you are still facing the issue, please try purging storage & revisions from Databricks Workspace.You can do this by going to Admin Settings --> Storage --> purgeI did it for my workspace where residual files may be causing th...
- 1 kudos