Hubert-Dudek
Databricks MVP

Real-time structured streaming is offering ms latency. Of course, if you want to save in the Delta format, it can take a few seconds and incur high costs due to frequent write operations to storage. The best solution in structured streaming is an event bus to event bus (like Kafka to Kafka), or for example, writes to an OLTP database like Lakebase


My blog: https://databrickster.medium.com/