Hi @nolanlavender008, You can reduce the backfill interval to a more frequent interval allowing timely processing of incoming files. You could experiment with different intervals to balance processing efficiency and resource utilization.
Another approach could be to implement a mechanism that prevents the backlog of files from building up in the first place. For example, you could consider setting up a monitoring system that alerts you when the number of unprocessed files reaches a certain threshold and then trigger the AutoLoader job manually to process the files.