Job is failing with exception ClientAuthenticationError: DefaultAzureCredential failed to retrieve a token from the included credentials.

Mohit_m
Databricks Employee
Databricks Employee

ClientAuthenticationError: DefaultAzureCredential failed to retrieve a token from the included credentials.

Attempted credentials:

EnvironmentCredential: EnvironmentCredential authentication unavailable. Environment variables are not fully configured.

Visit https://aka.ms/azsdk/python/identity/environmentcredential/troubleshoot to troubleshoot.this issue.

ManagedIdentityCredential: ManagedIdentityCredential authentication unavailable. The requested identity has not been assigned to this resource.

SharedTokenCacheCredential: SharedTokenCacheCredential authentication unavailable. No accounts were found in the cache.

VisualStudioCodeCredential: Failed to get Azure user details from Visual Studio Code.

Mohit_m
Databricks Employee
Databricks Employee

Below docs are for reference:

https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/identity/azure-identity/migration_guide....

there was a suggestion given to use

from azure.common.credentials import ServicePrincipalCredentials

instead of

from azure.identity import ClientSecretCredential

Also, please check if you have used the env variables for the authentication, sometimes you set it via init script so please check if the init script is in place

found out an init script was missing, the one setting the env variables for the authentication

View solution in original post