09-30-2022 05:44 AM
Hi @Bency Mathew You can use forEachBatch to perform the custom logic on each microbatch. Please refer to below document:
https://docs.databricks.com/structured-streaming/foreach.html#perform-streaming-writes-to-arbitrary-...
