I tried to follow the instructions found here: Connect to Azure Data Lake Storage Gen2 and Blob Storage - Azure Databricks | Microsoft Learn

E.g. this code:

spark.conf.set(
"fs.azure.account.key.<storage-account>.dfs.core.windows.net",
dbutils.secrets.get(scope="<scope>", key="<storage-account-access-key>"))

Doesn't work and gives error:

Configuration fs.azure.account.key.mystorageaccount.dfs.core.windows.net is not available.

Is there any plans to support this with serverless compute?