Hi, Databricks community,
I recently encountered an issue while using the 'azure.identity' Python library on a cluster set to the personal compute policy in Databricks. In this case, Databricks successfully returns the Azure Databricks managed user identity. However, when I change the cluster policy to shared compute, this functionality stops working.

Here's the code I've been using:

from azure.identity import DefaultAzureCredential
credential = DefaultAzureCredential() 

Please note that I've also attached a screenshot of the error that occurs only when selecting the shared compute cluster policy.