cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Unable to read data from ADLS using databricks serverless sql pool

NarenderKumar
New Contributor III

I have a data bricks workspace and an Azure data lake storage account.

Both are present in the same Vnet.

Unity catalog is enabled in the worksapce.

I have created some tables in unity catalog.

I am able to query the data from the tables when I use the any of the below 2 computes:

1. All purpose cluster

2. SQL Warehouse of type "PRO"

 

When I try to read the same table data using a SQL warehouse of the type "serverless", I get the below error:

This Azure storage request is not authorized. The storage account's 'Firewalls and virtual networks' settings may be blocking access to storage services. Please verify your Azure storage credentials or firewall exception settings.

I know that the access, firewalls and networking are not  a problem because it is working with all purpose cluster and PRO SQL warehouse. So I not know what is the problem here.

Please let me how to fix this.

1 ACCEPTED SOLUTION

Accepted Solutions

Hubert-Dudek
Esteemed Contributor III

but serverless is in Databricks Subscription so you need to whitelist traffic from there.

Please check that list. Storage firewall needs to allow connections https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/serv...

View solution in original post

2 REPLIES 2

Hubert-Dudek
Esteemed Contributor III

but serverless is in Databricks Subscription so you need to whitelist traffic from there.

Please check that list. Storage firewall needs to allow connections https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/serv...

BhawaniD
New Contributor II

I am having the same issue. How did you resolve it?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group