Azure Databricks Secret Management

[VJ3]

Hi,

Hope you both are doing well. I came to know that Databricks also provides secret management so I would like to compare it with some other well known secrets management solution like  Azure Key Vault, CyberArk in the market . Can someone provides me details about what are benefits of using Databricks Secrets Management instead? Why should we should use Databricks Secrets Management on Azure Databricks instead of Azure Key Vault? What are limitation of Databricks Secrets Management? Any security concerns using Secret Management offered by Databricks?

Thank you

[Hkesharwani]

Hi, 
A Databricks-backed secret scope is stored in an encrypted database managed by Azure Databricks. You can create a Databricks-backed secret scope using the Databricks CLI.
The reason one should prefer the datarbricks secret manager is, You can easily access and use secrets within your Databricks environment without additional configuration.
 The choice between Databricks Secret Manager and AWS KMS ultimately depends on your specific use case, requirements.
There is one advanced feature in Azure Databricks, with which you can access the azure key vault resources in the databricks secret manager using the DNS name and resource ID and then use the key.
It is kind of two layer security.  
To open Databricks secret visit the home page of your Databricks workspace and use url https://<Databricks_url>#secrets/createScope.

To know more about secret scope check out this Databricks blog https://learn.microsoft.com/en-us/azure/databricks/security/secrets/