topic Re: Way to enforce partition column in where clause in Data Engineering

Way to enforce partition column in where clause

NehaR — Mon, 18 Nov 2024 17:52:56 GMT

Hi All,

I want to know if is it possible to enforce that all queries must include a partition filter if the delta table is a partition table in databricks?

I tried the below option and set the required property but it doesn't work and I can still query test_table without passing the partition clause in the where condition.

ALTER TABLE test_table SET TBLPROPERTIES ('partitioned'='true', 'partitioned.query.required'='true');

Please let me know if it is doable in delta table.

Re: Way to enforce partition column in where clause

Alberto_Umana — Mon, 18 Nov 2024 19:03:55 GMT

Hi @NehaR,

Currently, Databricks does not support enforcing a requirement that all queries on a partitioned Delta table must include a partition filter. I see that there is a feature request internally to consider its implementation.

Re: Way to enforce partition column in where clause

NehaR — Mon, 18 Nov 2024 19:13:39 GMT

Any idea by When it will be available? Its a great feature to have to enforce use of partition columns for large tables.

Re: Way to enforce partition column in where clause

Alberto_Umana — Tue, 19 Nov 2024 13:56:02 GMT

At the moment there is not ETA, but will keep you posted!

Re: Way to enforce partition column in where clause

vitstransky — Fri, 27 Feb 2026 11:51:01 GMT

Hello, is there any update on the topic? We would appreciate this functionality as well.

Re: Way to enforce partition column in where clause

balajij8 — Sun, 01 Mar 2026 15:54:02 GMT

Liquid clustering is flexible and handles most of the issues automatically. You can use liquid clustering instead of forcing teams to use partition filter.