Configure jobs throttling for ephemeral cluster ETLs

RicksDB
Contributor III

Hi,

Is it possible to configure job throttling in order to queue jobs across a workspace after a given number of concurrent execution when using the ephemeral cluster pattern? The reason is mainly for cost control. We prefer reducing performance rather than increasing cost if too many jobs are executed for various reasons.

Thanks