Discover and redact pii

[Algocrat]

Hi! What is the best way to discover and redact pii. Does Databricks offer any frameworks, or set of methods, or processes that we may follow?

[szymon_dybczak · Accepted solution]

Hi @Algocrat ,

I think there is no out of the box solution in datbricks yet for this problem. 

You can try to use some open source tools like Presidio  ( look at below article).

Or if you are on azure, you can try to use Azure Purview

https://medium.com/databricks-platform-sme/identifying-and-tagging-pii-data-with-unity-catalog-87052...

[viswesh]

Hey @Algocrat  @szymon_dybczak , just wanted to let you know that Databricks is currently working on a product to tackle PII / sensitive data classification. If you're a current customer, we recommend you reach out to your account representative to learn more about how to try it out!