topic Applying Row Filters to a table removes the ability to DEEP CLONE or SHALLOW CLONE this table in Data Engineering

Applying Row Filters to a table removes the ability to DEEP CLONE or SHALLOW CLONE this table

Antoine_B — Wed, 31 Jul 2024 12:52:59 GMT

Hello,

In this documentation I see some limitations coming with using Row Filters, like "Deep and shallow clones are not supported"

We plan to use these Row Filters to hide sensitive data to some users.
But not having CLONE available for tables with Row Filters will probably discourage us to use Row Filters, because we use table CLONE to copy production data to our tests environments.

So, I would like to know if this CLONE not supported "issue" will be addressed soon ?

Thanks 🙂

Re: Applying Row Filters to a table removes the ability to DEEP CLONE or SHALLOW CLONE this table

NandiniN — Wed, 31 Jul 2024 18:36:20 GMT

Hi Antoine_B

The document explicitly calls out these limitations but there is no explicit mention of the roadmap for support.

I would request you to reachout to the Account Executive and SAs so that they can suggest the alternative approach for now. Meanwhile, you may also submit a feedback on this limitation and share the details of use case so that the feature requests can be prioritized. https://docs.databricks.com/en/resources/ideas.html

Re: Applying Row Filters to a table removes the ability to DEEP CLONE or SHALLOW CLONE this table

Antoine_B — Thu, 01 Aug 2024 08:27:24 GMT

Thanks for your answer, I created an Idea: https://ideas.databricks.com/ideas/DBE-I-1461; we'll see 🙂

An alternative approach would be to use views for the restricted users, that would implement this filters.
But it would create one view per table; which is not a satisfying way to solve our problem.