topic Re: Visualization of Structured Streaming in job. in Data Engineering

Visualization of Structured Streaming in job.

BorislavBlagoev — Tue, 05 Oct 2021 10:12:04 GMT

Does Databricks have feature or good pattern to visualize the data from Structured Streaming? Something like display in the notebook.

Re: Visualization of Structured Streaming in job.

spark-user — Tue, 05 Oct 2021 11:17:21 GMT

Hi @BorislavBlagoev,

Have you tried running SQL commands on your streaming job? You can interactively query the stream and notebook will display a visual dashboard of your data. You can read more about it here.

Let me know if you have any more question!

Re: Visualization of Structured Streaming in job.

BorislavBlagoev — Tue, 05 Oct 2021 12:11:42 GMT

But I don't want to display my data in notebook. @Spark User

Re: Visualization of Structured Streaming in job.

jose_gonzalez — Tue, 05 Oct 2021 17:20:36 GMT

hi @Borislav Blagoev ,

Have you seen the streaming tab? it will provide you the streaming statics. Please check the docs

or are you trying to visualize the data using an external monitoring system like datadog?

Re: Visualization of Structured Streaming in job.

BorislavBlagoev — Wed, 06 Oct 2021 08:59:53 GMT

I didn't know about that. Thanks!