Are row filters and column masks supported on foreign catalogs in Azure Databricks Unity Catalog?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-25-2025 05:58 PM
In my solution I am planning to bring in an Azure SQL Database to Azure Databricks Unity Catalog as Foreign Catalog. Are table row filters and column masks supported in my scenario ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2025 04:46 AM
Hi @Arindam19,
Thanks for your question. Yes it is supported.
https://learn.microsoft.com/en-us/azure/databricks/tables/row-and-column-filters
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2025 10:53 PM
Thanks @AlbertP !
Does the filtering happen in SQL Server or in Databricks?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-28-2025 04:36 AM
Hi @Arindam19,
Yes. Certain operations, including filtering, can be pushed down from Databricks to SQL Server. This is managed by querying the SQL Server directly via a federated connection, allowing SQL Server to handle the filter criteria and returning the filtered results to Databricks
https://learn.microsoft.com/en-us/azure/databricks/query-federation/sql-server