Atanu
Databricks Employee
Databricks Employee

@Herry Ramli​ Auto Loader works with DBFS paths as well as direct paths to the data source.

Read stream from landing "table" — we get the location of the glue catalog table for this and use format("cloudFiles") to utilize autoloader

I am not sure if above fits with your use case, but we got very less use case with glue and autoloader.

View solution in original post