Have you tried running SQL commands on your streaming job? You can interactively query the stream and notebook will display a visual dashboard of your data. You can read more about it here.
Welcome to Databricks Community: Lets learn, network and celebrate together
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.