topic Does Spark Structured streaming query require write-ahead logs for at least once delivery with ForeachBatch output sink? in Data Engineering https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-query-require-write-ahead-logs/m-p/4040#M875 <P>Is it sufficient to use the checkpoint directory with write-ahead logs?</P><P>BTW. I use Kafka connector to read data from EventHub</P> Tue, 23 May 2023 22:01:22 GMT DimaP 2023-05-23T22:01:22Z Does Spark Structured streaming query require write-ahead logs for at least once delivery with ForeachBatch output sink? https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-query-require-write-ahead-logs/m-p/4040#M875 <P>Is it sufficient to use the checkpoint directory with write-ahead logs?</P><P>BTW. I use Kafka connector to read data from EventHub</P> Tue, 23 May 2023 22:01:22 GMT https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-query-require-write-ahead-logs/m-p/4040#M875 DimaP 2023-05-23T22:01:22Z