• Failure in any of the active streaming queries causes the active run to fail and terminate all the other streaming queries. You do not need to use 

streamingQuery.awaitTermination()or 
spark.streams.awaitAnyTermination()

•  at the end of your notebook. Jobs automatically prevent a run from completing when a streaming query is active.

But seems like You have to call the above two function to fail all streams