de-qrosh
New Contributor III

But isn’t that a hard disadvantage compared to yarn clusters?

And the way I understood workflows (and the team behind the UI component among other things), we clearly shall reuse the same compute cluster and run parallel tasks.

If I would run spark-submits would the logs be separated as finally separate sessions would spawn?