https://community.databricks.com/t5/data-engineering/delta-table-is-not-writing-data-read-from-kafka/m-p/17307#M11334 <P></P> <P>Guys, could you help me? I'm reading 5 kafka threads through a list and saving the data in a Delta table The execution will be 1x a day, it seems that everything is working but I noticed that when I read the topic and it has no message, it still generates a directory with the delta table if on the same day I run it again and in this second run it reads some data in kafka even though I'm using ".outputMode("append")" it doesn't write anything to the existing delta table, now if I delete the checkpoint directory it works perfectly , what am I doing wrong ?</P> <P><span class="lia-inline-image-display-wrapper" image-alt="0693f000007OoRrAAK"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2465iD1E389EACE55D4FC/image-size/large?v=v2&amp;px=999" role="button" title="0693f000007OoRrAAK" alt="0693f000007OoRrAAK" /></span></P> <P></P> Mon, 26 Jul 2021 14:02:28 GMT Charbel 2021-07-26T14:02:28Z https://community.databricks.com/t5/data-engineering/delta-table-is-not-writing-data-read-from-kafka/m-p/17307#M11334 <P></P> <P>Guys, could you help me? I'm reading 5 kafka threads through a list and saving the data in a Delta table The execution will be 1x a day, it seems that everything is working but I noticed that when I read the topic and it has no message, it still generates a directory with the delta table if on the same day I run it again and in this second run it reads some data in kafka even though I'm using ".outputMode("append")" it doesn't write anything to the existing delta table, now if I delete the checkpoint directory it works perfectly , what am I doing wrong ?</P> <P><span class="lia-inline-image-display-wrapper" image-alt="0693f000007OoRrAAK"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2465iD1E389EACE55D4FC/image-size/large?v=v2&amp;px=999" role="button" title="0693f000007OoRrAAK" alt="0693f000007OoRrAAK" /></span></P> <P></P> Mon, 26 Jul 2021 14:02:28 GMT https://community.databricks.com/t5/data-engineering/delta-table-is-not-writing-data-read-from-kafka/m-p/17307#M11334 Charbel 2021-07-26T14:02:28Z