Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-10-2025 12:05 AM
I'm just guessing, because unfortunately we don't have insight into how this was implemented, but it seems to me that the Databricks engineers treat files uploaded within a short time interval as a single batch — most likely for optimization purposes. If a trigger were to be generated every second, it wouldn’t be a very efficient approach.
Even that option is specified in minutes (as if they assume that anything below that would still be treated as a single batch).