โ05-05-2023 06:25 AM
I've created workflow job (let say job A) and set up job cluster configuration for it.
Now I want to create another workflow job (job B) but use almost the same settings for job cluster.
I can see cluster settings in JSON (for both jobs) but I can't edit this JSON or use JSON from job A in the job B cluster.
Also, I can't choose job cluster for job A to use it in job B.
The only way I've found is to clone job A and substitute all of its tasks for those of B. In that case, I'm able to use the same job cluster configuration. But it is quite an unpleasant task to delete manually all of the tasks.
So maybe there is more convenient way to automate this process?
โ05-05-2023 08:55 AM
@Eugene Bikkininโ if i understood correct, you want to clone one of your job cluster right.
if that is the case got-->compute--> job compute --> click on right side at end (3 dots) --> you can see clone option
โ05-05-2023 09:12 AM
Interesting approach, thank you. But when cloning this job compute it is cloned as an all-purpose compute. And what I need is to clone it as an other job compute.
โ05-10-2023 07:39 AM
Also you can use terraform exporter with -match flag to get a .tf definition for a job A. Once initialized, you can define job B.
Another option is to use dbx
โ05-10-2023 07:41 AM
Never tried to use terraform. I think it's time I gave it a shot.
โ05-11-2023 03:30 AM
Using terraform exporter I got .tf file for job but the only mention of cluster is
job_cluster_key = "My_job_cluster"And there are no settings for this specific cluster. If I export clusters using terraform exporter I can get only all-purpose but not job clusters. So this approach doesn't work for me ๐
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!
Sign Up Now