Hi, I have configured delta sharing for external consumer in Azure Databricks. Azure Databricks and storage account are in VNET, no public access. The storage account has also disabled account key access and shared key authorization.
I'm running delta sharing client on local spark cluster and I'm getting such error:
io.delta.sharing.client.util.UnexpectedHttpStatus: HTTP request failed with status: HTTP/1.1 403 This request is not authorized to perform this operation. {"error":{"code":"AuthorizationFailure","message":"This request is not authorized to perform this operation.\nRequestId:68b35ea9-a01f-0042-4d35-9873d0000000\nTime:2025-03-18T18:44:33.2175103Z"}}, while accessing URI of shared table file
Similar issue like here: https://kb.databricks.com/security/cross-cloud-delta-sharing-query-results-in-403-response.
To solve this issue I have to add my delta sharing recipient IP address to azure storage firewall where I have data.
Is it required to open access to the storage account on firewall? Why is not used the Databrick storage account connector but "direct" access to storage account ? How delta sharing authorize to storage account if is disabled account key access and shared key authorization ?
