04-22-2023 01:23 PM
Hi all,
I have a Azure Databricks Setup (non-premium) and an ADLS Gen 2.0 setup. I am trying to access the ADLS Gen 2.0 containers via a simple access key mode for testing.
There is no error, if the ADLS Gen 2.0 is set to "Enable from all networks".
But, when it is set to "Enabled from selected virtual and IP Addresses" and "Allow Azure Services on the trusted services list to access this storage account", its doesn't work.
It errors with 403 Get operation error.
Operation failed: "This request is not authorized to perform this operation.", 403, GET, https://xxxxxxxxx.dfs.core.windows.net/raw?upn=false&resource=filesystem&maxResults=5000&timeout=90&..., AuthorizationFailure, "This request is not authorized to perform this operation. RequestId:342de772-c01f-0036-5a58-7553e4000000 Time:2023-04-22T20:24:04.6283599Z"
04-25-2023 07:40 AM
if you want to put access restrictions on the ADLS, there is some config to do:
https://learn.microsoft.com/en-us/azure/storage/common/storage-network-security?tabs=azure-portal
Basically you need to tell what is allowed and what isn't.
04-25-2023 10:21 AM
Hi @Werner Stinckens , I have already tried to all the respective IP address. Still its not working.
04-25-2023 11:25 PM
the Databricks VM's which are provisioned do not have static ip adresses; so you probably have to keep on adding IPs.
Better to use a subnet mask or use a VNet.
04-25-2023 11:00 AM
04-25-2023 11:11 AM
Hi @Fabio Santos , thanks for the response. All these ADLS Gen 2.0 network setting are set to public. But to secure the customer's data, it should contain a list of Whitelisted IP addresses.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group