Hi @L1000 ,
I assume you are using the DLT pipeline in triggered mode. The behavior will be as follows:
Autoloader works with a storage account and uses the cloudFiles.maxFilesPerTrigger or cloudFiles.maxBytesPerTrigger parameters to control how many files it ingests in a micro-batch. If both parameters are specified Databricks consumes up to the lower limit, whichever is reached first.
When new files are detected (such as those uploaded at 10 AM in your case), Autoloader ingests them in micro-batches. If the pipeline is triggered at 11 AM, it will consume all new data since the last load. In other words, it will consume all micro-batches consisting of the new files in bronze layer processing.
Only then, once the bronze layer processing is finished, DLT will begin processing the silver layer.