Lakshay
Databricks Employee
Databricks Employee

Hi @Sanjay Jain​ , Since you have provided the trigger as once, the maxFilesPerTrigger will not take effect here. With trigger once, all the files will be read together. You need to change the trigger for this option to come into effect.

Please refer the document here :

https://docs.databricks.com/ingestion/auto-loader/options.html#common-auto-loader-options

View solution in original post