Anonymous
Not applicable

@David Bernstein​ :

The error message "This request is not authorized to perform this operation using this permission" suggests that the credentials you provided in the spark configs do not have the necessary permissions to access the Azure storage account where you are trying to load the data.

You may need to check the following:

  • Ensure that the service principal you created in Azure has the correct permissions to access the storage account.
  • Ensure that the storage account key or the OAuth 2.0 credentials used for authentication are correct and have the necessary permissions.
  • Check if there are any network or firewall restrictions that might be blocking access to the storage account.

It may also be helpful to check the Azure portal logs to see if there are any additional error messages or information about the failed request.