GDPR/LGPD Compliance

[William_Scardua]

How do you work to compliance the GDPR/LGPD, in special to people data ?

have any suggestion ?

[Prabakar]

Hi @William Scardua​ Please refer to the below-mentioned documents for security and compliance-related information.

https://databricks.com/wp-content/uploads/2018/08/Databricks_Compliance_Program_Datasheet_180730.pdf

https://databricks.com/product/azure/security-and-compliance

https://databricks.com/product/databricks-enterprise-security-culture

https://docs.databricks.com/security/privacy/gdpr-delta.html

https://docs.databricks.com/security/index.html

[Hubert-Dudek · Accepted solution]

I recently set scanner in Azure for data lake using Azure Purview (I am not fun of results which it gives as it didn't detect anything, maybe I do something wrong). There is also AWS Macie to scan for personal data.

[jose_gonzalez]

Hi @William Scardua​ ,

I think you can reach out to our accounts team in case you would like to get more information on this topic.

[-werners-]

there is identifying PII data and handling/storing PII data.

Identifying can be done with Purview, Macie, other tools. Those are not free ofc, so if your env is pretty big it can be interesting. Otherwise, you could also do manual checks.

For storing: PII data should not be mixed with other data. Put it in a separated zone, encrypted etc with strict permissions AND also a solution for data retention.

Delta Lake makes this a lot easier tbh (delete statement).