topic Re: Store data using client side encryption and read data using client side encryption in Data Engineering

Store data using client side encryption and read data using client side encryption

Soma — Mon, 26 Sep 2022 15:27:32 GMT

Hi All,

I am looking for some options to add the Client side encryption feature of azure to store data in adls gen2

https://learn.microsoft.com/en-us/azure/storage/blobs/client-side-encryption?tabs=java

Any help will be highly appreciated

Note: Fernet side encryption is not accepted due to high sensitive data.

Re: Store data using client side encryption and read data using client side encryption

Soma — Wed, 28 Sep 2022 08:27:02 GMT

hi @Kaniz Fatma

Based on this article client side encryption sub-section

https://learn.microsoft.com/en-us/azure/storage/common/storage-service-encryption#client-side-encryption-for-blobs-and-queues

I can do the encryption using sdk which is fine for small volume of data,

but my question is on how to decrypt using spark dataframe reader do we have any ref example to this

Re: Store data using client side encryption and read data using client side encryption

Anonymous — Mon, 21 Nov 2022 03:24:17 GMT

Hi @somanath Sankaran

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: Store data using client side encryption and read data using client side encryption

Soma — Sun, 11 Dec 2022 10:25:51 GMT

@Vidula Khanna

We are going with fernet encryption as direct method is not available