koji_kawamura
Databricks Employee
Databricks Employee

Hi @Jorge3

Since you mentioned the "cloudFiles.useNotifications" option, I assume you know AutoLoader's File Detection Mode. It should be the best solution to your situation. Have you tried it already and encountered an issue? If so, please let us know the details.

This video shows a detailed step-by-step guide for setting up Autoloader ingestion using file detection mode from an ADLS storage location. I found it helpful and hope it will be for you, too!