Masking techniques for more PII columns
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-01-2024 01:02 AM
Hi Databricks Team,
We would appreciate it if you could inform us about the situations when Column-Masking, Row-Level Filtering, and Attributed-Based Masking should be utilized, as well as the recommended technique for handling large data volumes containing 100's of (around 1k ) PII columns.
Regard
Phanindra
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-17-2024 07:03 PM
Thanks for the answers. To extend this question further, how can we apply column masks to DLT tables? DLT table is using Materialized Views under the hood. And databricks has mad coumn mask enabled for materialized view under Public Review. But same code not working in DLT table yet, any idea how or when DLT tables could apply column mask functions?
DLT tables column mask not working yet:
Regards
Bing
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-31-2024 04:00 PM
Hello Bing ,
I was able to apply row-filter and column mask to DLT (both streaming tables and mv), it is still in Public preview though.
The DLT code and the function definitions are attached in the screenshots.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-03-2024 09:46 PM
@Meghla-C Thanks for the update. Just to confirm, that the same source code to mask column which did not working before now works in DLT in my environment. Great job.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-31-2024 11:52 PM
Agree with @Meghla-C , https://databricks.aha.io/ideas/ideas/DB-I-7941 this was the feature request and if you see the status, it is in preview.

