Unable to Enable Unity Catalog – Azure Managed Identity Credential Not Found

Shubh5073
Visitor

Hi Databricks Community,

I am trying to enable Unity Catalog in my Azure Databricks account. As part of the setup, I created an Azure Databricks Access Connector and assigned its managed identity the required permissions on my ADLS Gen2 storage account.

I then provided the Access Connector Resource ID and ADLS path in the Databricks Account Console. However, I am getting the following error:

Azure Managed Identity Credential with Access Connector Id /subscriptions/7c585268-20a0-4c57-b952-bf6a47dd315a/resourceGroups/shubh_rg/providers/Microsoft.Databricks/accessConnectors/shubh_connect and Managed Identity ID: for Account Id: 1b687630-77a8-4ff1-888e-a2837de30bf8 could not be found.

Configuration

  • Azure Subscription ID: 7c585268-20a0-4c57-b952-bf6a47dd315a
  • Resource Group: shubh_rg
  • Access Connector: shubh_connect
  • Access Connector Resource ID: /subscriptions/7c585268-20a0-4c57-b952-bf6a47dd315a/resourceGroups/shubh_rg/providers/Microsoft.Databricks/accessConnectors/shubh_connect
  • Databricks Account ID: 1b687630-77a8-4ff1-888e-a2837de30bf8
  • Storage: Azure Data Lake Storage Gen2
  • Managed Identity: System-assigned managed identity
  • ADLS Role: Storage Blob Data Contributor

The Access Connector has been successfully created in Azure, and the managed identity has been assigned the required permissions on the ADLS storage account.

However, the Databricks Account Console is unable to find or validate the Access Connector.

Questions

  1. Why is the Databricks Account Console unable to find the Access Connector?
  2. Is there any account-level configuration or prerequisite required before creating the Unity Catalog metastore?
  3. Does the Access Connector need to be associated with the Databricks workspace/account in any additional way?
  4. Is there any issue with the managed identity configuration or Access Connector Resource ID?

Any guidance on how to resolve this issue would be greatly appreciated.

Thank you.