topic Re: Error while mounting ADLS Gen 2 storage account to Az Databricks in Data Engineering

Error while mounting ADLS Gen 2 storage account to Az Databricks

pgaddam — Wed, 24 Aug 2022 17:25:46 GMT

Hello Team

I am facing troubles while mounting storage account onto my databricks. Some background on my setup:

Storage Account - stgAcc1 - attached to vnet1 and it's subnets

Databricks - databricks1 - attached to 'workers-vnet' and subnets - these were created while deploying the resource from Azure portal

For the connectivity to take place, I have set the firewall settings on stgAcc1 to allow any networks.

Now that I try to mount the stgAcc1 on databricks1 I see the below error:

java.io.FileNotFoundException: Operation failed: &#34;The specified container does not exist.&#34;, 404, HEAD, https://stgAcc1.blob.core.windows.net/containerName?resource=filesystem&amp;timeout=90

I am using abfss protocol and authenticating via service principal. I have double checked my storage account name and container name, and service principal is set to have storage account contributor rights on storage account.

Any thoughts on where it's going wrong please?

Re: Error while mounting ADLS Gen 2 storage account to Az Databricks

Vidula — Mon, 12 Sep 2022 13:28:14 GMT

Hi @Pranith Gaddam

Does @Debayan Mukherjee response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks!

Re: Error while mounting ADLS Gen 2 storage account to Az Databricks

Debayan — Thu, 25 Aug 2022 07:14:27 GMT

Please follow the steps to configure and mount azure blob in https://docs.databricks.com/_static/notebooks/data-sources/mount-azure-blob-storage.html and also this has detailed steps: https://blog.cloudthat.com/step-by-step-guide-to-connect-azure-databricks-to-an-azure-storage-account/.

For the error you are receiving, you can try changing blobpropertysettings:

https://stackoverflow.com/questions/18864002/the-specified-container-does-not-exist