Delta Sharing Azure Databricks Private Storage

[Zacp]

I am looking for details on how Delta Sharing is configured on Azure. If your storage account is private, do you need to whitelist the IP for the recipient? Recipient is not using Databricks.

[Kaniz_Fatma]

Hi @Zacp, When setting up Delta Sharing on Azure, here are the steps you need to follow:

1. As an Azure Databricks account admin:

   • Log in to the Azure Databricks account console.
   • In the sidebar, click on “Catalog.”
   • Click the name of a metastore to open its details.
   • Enable Delta Sharing by checking the corresponding checkbox. This allows a Databricks user to share data outside their organization.
   • Configure the recipient token lifetime¹.

2. If creating a new Unity Catalog-enabled workspace is not an option, you can use the open source Delta Sharing project to deploy your own Delta Sharing server. This server can be used to share Delta tables from any platform. The initial provider setup includes enabling Delta Sharing on a Unity Catalog metastore.

Behind the scenes, the Delta Sharing server uses the hadoop-azure library to read a shared Delta tab...².

Feel free to explore Delta Sharing in Azure Databricks—it’s a secure data-sharing platform that allo.... If you have any more questions, feel free to ask! 😊

[Zacp]

@Kaniz_Fatma Thanks for the response.

I have an issue with a customer claiming they cannot access the delta table. However, they can get the list of tables and I see no issues in the system audit table. The storage account is not public, and the tables are external delta tables. How does Delta Sharing access data from the Azure storage account? What credential does it use? In this case would I have to whitelist the customer's IP?