@Jin Kim​ ,

• When you set tasks in a job, first put some ***** task and then every streaming as separated task depended on first (see image below how logic will look like) so there will be only one job,
• Inside every streaming task, use spark.streams.awaitAnyTermination() to monitor it, and when failed to restart - custom logic,
• redirect fail notifications messages to pagerduty or something to know that job is falling,
• set maximum one concurrent job run and frequently run, like every 5 mins, so it will automatically run again when something fails.