Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
Have you tried running SQL commands on your streaming job? You can interactively query the stream and notebook will display a visual dashboard of your data. You can read more about it here.