Hi Kaniz,

Thank you for your response.

I have read through all your points from the official documentation page.

Can you let me know how can I achieve below?

• I have 3 million json files each of 65KB, so total size is 186GB. It is in adls gen2 storage container and the queue contains all the event notifications
•  
• I want to process 10GB data files per micro batch of autoloader streaming with file event notification set to true. SO total batch would come around 20.
• What configuration cluster I have to use and what other config I have to set other than cloudFiles.maxBytesPerTrigger to 10g.
• The readstream code is as below.
  •