Hi @allyallen, thanks for the explanation. Yes, you are right; there is no direct way to change the cluster for a task while within the same job. However, you can still achieve a somewhat similar result by making a few tweaks.

You can start by separating the job into separate jobs, say job_1 and job_2. The task that runs NB1 will be in job_1, and then the other tasks can be in job_2.

Since you already know the job name/id for job_2, you can use the update job settings to update the cluster for the job. Of course, the downside to this is that you'll need to know the job_id beforehand to and you'd be using either NB1 to update job_2's cluster. That's one approach.

Another approach is that you can create job_2 programmatically in NB1 every time the t-shirt size changes

eniwoke_0-1752596597545.png

Let me know if it helps 🙂

Eni

View solution in original post