topic Re: Does Spark Structured Streaming supports `OutputMode.Update` for Delta tables? in Data Engineering https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-supports-outputmode-update-for/m-p/25864#M18059 <P>Nope, it's not supported, but you could use a MERGE statement inside of a forEachBatch streaming sync </P><P></P><P>Documentation on MERGE</P><P><A href="https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html" target="test_blank">https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html</A></P><P></P><P>Documentation for arbitrary streaming sinks </P><P><A href="https://docs.databricks.com/spark/latest/structured-streaming/foreach.html" target="test_blank">https://docs.databricks.com/spark/latest/structured-streaming/foreach.html</A></P> Mon, 07 Jun 2021 18:11:04 GMT ruslan 2021-06-07T18:11:04Z Does Spark Structured Streaming supports `OutputMode.Update` for Delta tables? https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-supports-outputmode-update-for/m-p/25863#M18058 <P>Does Spark Structured Streaming&nbsp;supports `OutputMode.Update` for Delta tables?</P> Mon, 07 Jun 2021 18:09:37 GMT https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-supports-outputmode-update-for/m-p/25863#M18058 ruslan 2021-06-07T18:09:37Z Re: Does Spark Structured Streaming supports `OutputMode.Update` for Delta tables? https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-supports-outputmode-update-for/m-p/25864#M18059 <P>Nope, it's not supported, but you could use a MERGE statement inside of a forEachBatch streaming sync </P><P></P><P>Documentation on MERGE</P><P><A href="https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html" target="test_blank">https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html</A></P><P></P><P>Documentation for arbitrary streaming sinks </P><P><A href="https://docs.databricks.com/spark/latest/structured-streaming/foreach.html" target="test_blank">https://docs.databricks.com/spark/latest/structured-streaming/foreach.html</A></P> Mon, 07 Jun 2021 18:11:04 GMT https://community.databricks.com/t5/data-engineering/does-spark-structured-streaming-supports-outputmode-update-for/m-p/25864#M18059 ruslan 2021-06-07T18:11:04Z