Error while mounting ADLS Gen 2 storage account to Az Databricks

[pgaddam]

Hello Team

I am facing troubles while mounting storage account onto my databricks. Some background on my setup:

Storage Account - stgAcc1 - attached to vnet1 and it's subnets

Databricks - databricks1 - attached to 'workers-vnet' and subnets - these were created while deploying the resource from Azure portal

For the connectivity to take place, I have set the firewall settings on stgAcc1 to allow any networks.

Now that I try to mount the stgAcc1 on databricks1 I see the below error:

java.io.FileNotFoundException: Operation failed: "The specified container does not exist.", 404, HEAD, https://stgAcc1.blob.core.windows.net/containerName?resource=filesystem&timeout=90

I am using abfss protocol and authenticating via service principal. I have double checked my storage account name and container name, and service principal is set to have storage account contributor rights on storage account.

Any thoughts on where it's going wrong please?

[Debayan]

Please follow the steps to configure and mount azure blob in https://docs.databricks.com/_static/notebooks/data-sources/mount-azure-blob-storage.html and also this has detailed steps: https://blog.cloudthat.com/step-by-step-guide-to-connect-azure-databricks-to-an-azure-storage-accoun....

For the error you are receiving, you can try changing blobpropertysettings:

https://stackoverflow.com/questions/18864002/the-specified-container-does-not-exist

[Vidula]

Hi @Pranith Gaddam​ 

Does @Debayan Mukherjee​  response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks!