Does Spark Structured Streaming supports `OutputMode.Update` for Delta tables?

ruslan
Databricks Employee
Databricks Employee

Does Spark Structured Streaming supports `OutputMode.Update` for Delta tables?

ruslan
Databricks Employee
Databricks Employee

Nope, it's not supported, but you could use a MERGE statement inside of a forEachBatch streaming sync

Documentation on MERGE

https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-merge-into.html

Documentation for arbitrary streaming sinks

https://docs.databricks.com/spark/latest/structured-streaming/foreach.html