cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Orchestration Preview - Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

AlexandrePellet
New Contributor

I've created a new job with the new UI / feature enabled.

I managed to create one task with a new job cluster successfully but when adding a second task with a new job cluster and trying to save it I received the following error:

Error updating [JobName] - Either new_cluster or existing_cluster_id must be specified.

I've yet to try something similar with the API but seems to me I cannot even create a second task with anything other than an all purpose cluster.

Any idea what I might be doing wrong, has anyone had similar issues with the new feature preview?

1 ACCEPTED SOLUTION

Accepted Solutions

Atanu
Databricks Employee
Databricks Employee

are you still have the same issue @kalyana krishnasampath pendyala​  @Alexandre Pelletier​ ? looks like the cluster is not attaching properly

View solution in original post

3 REPLIES 3

NFCU
New Contributor II

I am facing the same error. Is there any solution for this

Atanu
Databricks Employee
Databricks Employee

are you still have the same issue @kalyana krishnasampath pendyala​  @Alexandre Pelletier​ ? looks like the cluster is not attaching properly

eignerfr
New Contributor II

Hi,

I have a similar issue.

I'm using the 14 day free trial, setting up the default basic-starter cluster.

Then I just followed the basic introduction of dbx with python.

https://docs.databricks.com/dev-tools/dbx.html

Command Execute is working, but when using deploy I get the error message from above.

greetings

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group