yoongkang
Databricks Partner

can try using change data feed in combination with Structured Streaming to incrementally process changes from Delta tables.

Hope it helps