Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2025 11:19 PM
Hi Community,
I’ve been working on a data pipeline using Databricks Delta Live Tables (DLT) with Unity Catalog. My setup saves data into Azure Data Lake Storage (ADLS) for streaming tables. However, I’ve noticed that Unity Catalog encrypts various components, including the schema name, table name, and the data itself, making it unreadable in the ADLS container.
Now, I want to create a shortcut or establish access to these tables in Microsoft Fabric for further use and analysis.
Here are a few specific details:
- The tables are managed through Unity Catalog in Databricks.
- The data resides in ADLS but appears encrypted and not directly readable outside Databricks.
- I want to seamlessly access or link these tables in MS Fabric while maintaining security and compatibility.
I’d appreciate any suggestions or best practices on how to:
- Create a shortcut or link to these tables in MS Fabric.
- Configure MS Fabric to work with Unity Catalog-managed tables stored in ADLS.
- Overcome challenges related to encryption and schema compatibility.
Thanks in advance for your insights!
Looking forward to hearing your ideas and experiences.
Labels:
- Labels:
-
Delta Sharing
-
Unity Catalog