Thank you for your response!

I've tried something similar, added time.sleep(10) between table creation and autoloader initialization, but it did not work.

What worked was separating the table creation and the autoloader initialization into different cells in the Databricks notebook. I’ll mark your response as the accepted solution, but I’ll also include mine in case someone else finds it useful.

Still, accepting your reply as solution, and writing mine, as someone mind find them useful.