Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
During the recent Data + AI Summit, there was a mention of a new real-time streaming mode in Delta Live Tables (DLT) that enables sub-300 millisecond latency. This sounds really promising!
Could someone please guide me on:
How do we enable this new real-time mode in DLT?
Is it different from using pipelines .trigger. interval = "1 second" or is there a new streaming engine involved?