topic Re: Are row filters and column masks supported on foreign catalogs in Azure Databricks Unity Catalog in Get Started Discussions

Are row filters and column masks supported on foreign catalogs in Azure Databricks Unity Catalog?

Arindam19 — Wed, 26 Feb 2025 01:58:57 GMT

In my solution I am planning to bring in an Azure SQL Database to Azure Databricks Unity Catalog as Foreign Catalog. Are table row filters and column masks supported in my scenario ?

Re: Are row filters and column masks supported on foreign catalogs in Azure Databricks Unity Catalog

Alberto_Umana — Thu, 27 Feb 2025 12:46:49 GMT

Hi @Arindam19,

Thanks for your question. Yes it is supported.

https://learn.microsoft.com/en-us/azure/databricks/tables/row-and-column-filters

Re: Are row filters and column masks supported on foreign catalogs in Azure Databricks Unity Catalog

Arindam19 — Fri, 28 Feb 2025 06:53:58 GMT

Thanks @AlbertP !
Does the filtering happen in SQL Server or in Databricks?

Re: Are row filters and column masks supported on foreign catalogs in Azure Databricks Unity Catalog

Alberto_Umana — Fri, 28 Feb 2025 12:36:05 GMT

Hi @Arindam19,

Yes. Certain operations, including filtering, can be pushed down from Databricks to SQL Server. This is managed by querying the SQL Server directly via a federated connection, allowing SQL Server to handle the filter criteria and returning the filtered results to Databricks

https://learn.microsoft.com/en-us/azure/databricks/query-federation/sql-server