I have a Unity catalog enabled workspace where I am trying to setCheckpointDir during runtime. The method looks to authenticate using fs.azure.account.key instead of storage credentials. I am using databricks access connector which has "Storage Blob Data Contributor" role on my storage account. The relevant containers are also added as external locations.

Error:

Py4JJavaError: An error occurred while calling o350.setCheckpointDir.
: Failure to initialize configuration for storage account: Invalid configuration value detected for fs.azure.account.keyInvalid configuration value detected for fs.azure.account.key