Way to enforce partition column in where clause
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-18-2024 09:52 AM
Hi All,
I want to know if is it possible to enforce that all queries must include a partition filter if the delta table is a partition table in databricks?
I tried the below option and set the required property but it doesn't work and I can still query test_table without passing the partition clause in the where condition.
ALTER TABLE test_table SET TBLPROPERTIES ('partitioned'='true', 'partitioned.query.required'='true');
Please let me know if it is doable in delta table.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-18-2024 11:03 AM
Hi @NehaR,
Currently, Databricks does not support enforcing a requirement that all queries on a partitioned Delta table must include a partition filter. I see that there is a feature request internally to consider its implementation.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-18-2024 11:13 AM
Any idea by When it will be available? Its a great feature to have to enforce use of partition columns for large tables.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-19-2024 05:56 AM
At the moment there is not ETA, but will keep you posted!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2026 03:51 AM
Hello, is there any update on the topic? We would appreciate this functionality as well.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-01-2026 07:54 AM
Liquid clustering is flexible and handles most of the issues automatically. You can use liquid clustering instead of forcing teams to use partition filter.
