โ11-18-2022 02:18 AM
โ11-18-2022 08:26 AM
@Anubhav Guptaโ Databricks is hosted on the cloud provider which means that all resources used by databricks in the backend are in the cloud. For instance, if you create a cluster, the VMs are launched in AWS as EC2 instances. So the integration of KMS has to be done on the cloud where the resources are present.
Does this clarify your question?
โ11-18-2022 07:51 AM
Hi @Anubhav Guptaโ , you might have to import your external KMS key to AWS KMS or AKV and then integrate it with Databricks.
โ11-18-2022 07:58 AM
Thanks @Vivian Wilfredโ for the reply.
But I actually wanted to know, How can external KMS providers integrate with Databricks directly like AWS and AKV.
โ11-18-2022 08:26 AM
@Anubhav Guptaโ Databricks is hosted on the cloud provider which means that all resources used by databricks in the backend are in the cloud. For instance, if you create a cluster, the VMs are launched in AWS as EC2 instances. So the integration of KMS has to be done on the cloud where the resources are present.
Does this clarify your question?
โ11-18-2022 08:56 AM
@Vivian Wilfredโ Alright I got you.
So, you mean to say we cannot run Databricks on its own or without having any cloud provider support such as AWS and AKV?
โ11-18-2022 09:10 AM
Yes, that's correct.
Please select the comment as 'best answer' to resolve the query. Thanks!
โ11-20-2022 11:14 PM
Hi @Anubhav Guptaโ, We havenโt heard from you since the last response from @Debayan Mukherjeeโ โ, and I was checking back to see if his suggestions helped you.
Or else, If you have any solution, please share it with the community, as it can be helpful to others.
Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.