How do I process each new record when using autoloader.

[Gabriel0007]

For instance, I'm ingesting webhook data into a delta table with autoloader and need to run a process for each new record as it arrives.

[AmanSehgal]

With autoloader, you can do something like changelog and record data about operations performed on each micro batch - like affected id, I/U/D, timestamp etc..

Then you can make use of this changelog table, and run subsequent processes for each row affected per micro batch..

[Gabriel0007]

Thank you for the info. I'm just starting out with Databricks.