External KMS integration with Databricks like AWS KMS, Azure Key Vault.

[AnubhavG]

I would like to know how we can integrate Databricks with External KMS providers, like currently it is doing with AWS KMS and Azure Key Valut?

Can we import keys from any other KMS?

[Vivian_Wilfred]

Hi @Anubhav Gupta​ , you might have to import your external KMS key to AWS KMS or AKV and then integrate it with Databricks.

[AnubhavG]

Thanks @Vivian Wilfred​ for the reply.

But I actually wanted to know, How can external KMS providers integrate with Databricks directly like AWS and AKV.

[Vivian_Wilfred · Accepted solution]

@Anubhav Gupta​ Databricks is hosted on the cloud provider which means that all resources used by databricks in the backend are in the cloud. For instance, if you create a cluster, the VMs are launched in AWS as EC2 instances. So the integration of KMS has to be done on the cloud where the resources are present.

Does this clarify your question?

[AnubhavG]

@Vivian Wilfred​ Alright I got you.

So, you mean to say we cannot run Databricks on its own or without having any cloud provider support such as AWS and AKV?

[Vivian_Wilfred]

Yes, that's correct.

Please select the comment as 'best answer' to resolve the query. Thanks!

[Kaniz]

Hi @Anubhav Gupta​, We haven’t heard from you since the last response from @Debayan Mukherjee​ ​, and I was checking back to see if his suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.