eniwoke
Contributor II

Hi @allyallen, just to clarify your use case to see if I can provide a solution:

Are you saying you have a single job with multiple tasks, and each of those tasks runs the same notebook (e.g., notebook_1), but you'd like the compute cluster to vary depending on the tenant's t-shirt size (S, M, L) determined within the notebook and a task?

Or is it more that you have a parent job (e.g., job_1) which dynamically triggers other jobs or notebooks, and you'd like each of those to run on the appropriate cluster based on the tenant’s size?

Eni