topic Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified. in Data Engineering

Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

AlexandrePellet — Mon, 23 Aug 2021 14:56:00 GMT

I've created a new job with the new UI / feature enabled.

I managed to create one task with a new job cluster successfully but when adding a second task with a new job cluster and trying to save it I received the following error:

Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

I've yet to try something similar with the API but seems to me I cannot even create a second task with anything other than an all purpose cluster.

Any idea what I might be doing wrong, has anyone had similar issues with the new feature preview?

Re: Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

NFCU — Tue, 26 Oct 2021 15:49:41 GMT

I am facing the same error. Is there any solution for this

Re: Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

Atanu — Fri, 13 May 2022 03:07:34 GMT

are you still have the same issue @kalyana krishnasampath pendyala @Alexandre Pelletier ? looks like the cluster is not attaching properly

Re: Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

eignerfr — Fri, 22 Jul 2022 07:40:12 GMT

Hi,

I have a similar issue.

I'm using the 14 day free trial, setting up the default basic-starter cluster.

Then I just followed the basic introduction of dbx with python.

https://docs.databricks.com/dev-tools/dbx.html

Command Execute is working, but when using deploy I get the error message from above.

greetings