Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-15-2025 12:13 AM
Hi @eniwoke
Thank you for replying!
I have one job that has a string of other jobs and notebooks as tasks. This job is designed to be run against different tenants as a way of ingesting data.
NB1 at the beginning of the job determines the t-shirt size for the tenant and if it's S, all subsequent tasks and jobs need to run on the S cluster. If NB1 finds the t-shirt size is M, all following tasks and jobs will run on the M cluster.
At the moment, I can only set one cluster per task and can't see a way of dynamically setting the cluster to use based on the output of a previous task.
Hope this clarifies the ask a little bit!
Thanks!