I have a data bricks workspace and an Azure data lake storage account.
Both are present in the same Vnet.
Unity catalog is enabled in the worksapce.
I have created some tables in unity catalog.
I am able to query the data from the tables when I use the any of the below 2 computes:
1. All purpose cluster
2. SQL Warehouse of type "PRO"
When I try to read the same table data using a SQL warehouse of the type "serverless", I get the below error:
This Azure storage request is not authorized. The storage account's 'Firewalls and virtual networks' settings may be blocking access to storage services. Please verify your Azure storage credentials or firewall exception settings.
I know that the access, firewalls and networking are not a problem because it is working with all purpose cluster and PRO SQL warehouse. So I not know what is the problem here.
Please let me how to fix this.