Databricks Community

TienDat · 10-12-2023

Dear all,We are working on the column masking topic recently, using the column filter feature of Unity Catalog.We recently face the problem of masking a nested column (a sub-column within a STRUCT type column).We just wonder if this is even possible ...

TienDat · 10-03-2023

Dear community,Our company is using Databricks and we are happy to have Unity Catalog emerged to solve part of our Data Governance problems. We are very interested in the Table Insights feature which is newly introduced (View frequent queries and use...

TienDat · 12-27-2023

Thanks for your suggestion.The core concern of this thread remains the same, does not matter if we use VIEW or MASKING functions. That is to which extend Databricks SQL support complex type manipulation? Can we make a function/a VIEW definition that ...

TienDat · 12-27-2023

For your Decimal datatype masking, you just need to make sure that your SQL function declaration contains correct datatype. Something like: CREATE FUNCTION catalogName.default.my_function(input decimal(x, y)) RETURNS DECIMAL(x, y) RETURN input;It sho...

TienDat · 10-12-2023

To update on this topic, not only the STRUCT type but also the ARRAY type is having issue with applying the MASK function. My guess is that since both STRUCT and ARRAY types are not standard types of SQL, the ALTER COLUMN to add MASK to those columns...

TienDat · 10-04-2023

Dear @Retired_mod, Thanks for your answer. I just checked and indeed such information can be queried to information_schema tables.Anyways, do you have the information if there exists a plan to expose such insights via REST API, or not at all?The reas...

Databricks Community

User Stats

User Activity

Filter sensitive data on nested column

Unity Catalog: Expose REST API for Table Insights

Re: Filter sensitive data on nested column

Re: Filter sensitive data on nested column

Re: Filter sensitive data on nested column

Re: Unity Catalog: Expose REST API for Table Insights