How to retrieve Auto Loader client secret from Azure Key Vault?

[Magnus]

I'm using Auto Loader in a SQL notebook and I would like to configure file notification mode, but I don't know how to retrieve the client secret of the service principal from Azure Key Vault. Is there any example notebook somewhere? The notebook is part of a Delta Live Tables workflow.

[Geeta1 · Accepted solution]

Hi @Magnus Johannesson​ , you must use the Secrets utility (dbutils.secrets) in a notebook or job to read a secret.

https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-utils#dbutils-secrets

Hope it helps!

[Magnus]

Thanks @Geeta Sai Boddu​! It worked when I converted the notebook to Python and used the Secrets utility. I was hoping that it could be done in a SQL notebook, but maybe that's not supported.

[Geeta1]

Hey @Magnus Johannesson​ , great! Yeah, I don't think we can do it using SQL.