[ Databricks - Delta sharing ] Issue with Delta Sharing in Databricks: Unable to Query Shared Views

[MAR1]

Hi guys, I've encountered an issue while attempting to query shared views via Delta Sharing in Databricks. We are using Delta Sharing Databricks-to-Databricks protocol to share data from a databricks environment deployed on azure to another databricks environment deployed on aws. We could see the schema and views shared with us but when we tried to query the data we got the following errors:                                                                                          

1. By using a Serverless sql warehouse compute instance we got this error:

• This Azure storage request is not authorized. The storage account's 'Firewalls and virtual networks' settings may be blocking access to storage services. Please verify your Azure storage credentials or firewall exception settings.According to the Databricks documentation, if our Databricks account is different from the provider's, we must use a Serverless SQL warehouse to query shared views. However, serverless SQL warehouses do not have public IP addresses ( Serverless SQL warehouses do not have public IP addresses. (https://docs.databricks.com/en/admin/sql/serverless.html )) , which poses a challenge for IP whitelisting on the Azure storage side. Anyone has an idea on how to fix this ? Thanks !  

I also tried to use this compute instances :

  Using a shared cluster we got this error:

• UnityCatalogServiceException: [RequestId=69be237f-xxxx-4835-xxxx-285afe90a20f ErrorClass=CUSTOMER_UNAUTHORIZED] The current compute is not supported to query a shared view via Delta Sharing. If the view is shared under the same account, you must use a shared cluster or SQL warehouse. Sharing outside of the same account requires a Serverless SQL warehouse.

 Using a sql warehouse pro instance we got this error:

• SparkConnectGrpcException: (shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.contracts.exceptions.SASTokenProviderException) Failed to acquire a SAS token for list on /managed/__unitystorage/catalogs/xxxxx-5819-xxxxx-b7df-e8a8cd5f4308/tables/xxxx-0ffb-48ee-af3f-xxxxx/_delta_log due to java.util.concurrent.ExecutionException: com.databricks.sql.managedcatalog.UnityCatalogServiceException: [RequestId=xxxx-4064-47b2-98d1-af809b80a001 ErrorClass=CUSTOMER_UNAUTHORIZED] The current compute is not supported to query a shared view via Delta Sharing. If the view is shared under the same account, you must use a shared cluster or SQL warehouse. Sharing outside of the same account requires a Serverless SQL warehouse.