11-20-2023 08:57 AM
Hi Databricks, Could you please guide me on the below scenario?
Here is the use case we are trying to solve for
11-21-2023 01:52 AM
Hi @Phani1 ,
Let’s break down your scenario and address each part:
Data Encryption at S3 Bucket Using Customer-Managed Key:
Using Customer-Managed Keys for Workspace Storage:
Custom UDFs and AES Encryption:
aes_encrypt
and aes_decrypt
.In summary, Databricks allows you to manage your own keys for workspace storage encryption, ensuring data security while providing flexibility for custom UDFs and other data processing tasks. If you encounter any specific challenges during implementation, feel free to seek further assistance...
Happy encrypting! 🛡️🔒
11-21-2023 01:52 AM
Hi @Phani1 ,
Let’s break down your scenario and address each part:
Data Encryption at S3 Bucket Using Customer-Managed Key:
Using Customer-Managed Keys for Workspace Storage:
Custom UDFs and AES Encryption:
aes_encrypt
and aes_decrypt
.In summary, Databricks allows you to manage your own keys for workspace storage encryption, ensuring data security while providing flexibility for custom UDFs and other data processing tasks. If you encounter any specific challenges during implementation, feel free to seek further assistance...
Happy encrypting! 🛡️🔒
11-22-2023 06:13 AM
Thanks for the clear guidance! Integrating AWS KMS for CMK in Databricks and using custom UDFs for encryption/decryption align perfectly with our goals. Appreciate your assistance!
11-22-2023 10:37 PM
Hi @DeborahRoe , I want to express my gratitude for your effort in selecting the most suitable solution. It's great to hear that your query has been successfully resolved. Thank you for your contribution.
12-06-2023 12:12 AM
To replace "Voltage" with Databricks encryption, follow these steps: set up a Customer Managed Key in AWS, configure the S3 bucket, read data in Databricks, and implement custom UDFs for AES encryption/decryption.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.