Raman_Unifeye
Honored Contributor III

Yes, for your setup, Databricks Auto Loader will create a separate event queue for each independent stream running with the cloudFiles.useManagedFileEvents = true option.

As you are running - 1 stream per table, 1 unique directory per stream and 1 unique checkpoint per stream

The result is multiple, independent event queues—one tied to each stream/table path


RG #Driving Business Outcomes with Data Intelligence