szymon_dybczak
Esteemed Contributor III

I'm just guessing, because unfortunately we don't have insight into how this was implemented, but it seems to me that the Databricks engineers treat files uploaded within a short time interval as a single batch — most likely for optimization purposes. If a trigger were to be generated every second, it wouldn’t be a very efficient approach.
Even that option is specified in minutes (as if they assume that anything below that would still be treated as a single batch).

szymon_dybczak_0-1752131111862.png