If there is only a small difference between the number of files, that is probably not it (unless there is serious data skew).
DLT probably adds this config for data quality reasons (which might be defined on the dlt).  But as I do not use dlt, I could be wrong here.
But it certainly could be the cause because the filters will be evaluated on read.