cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to exit the entire job in the orchestration scenario?

QPeiran
New Contributor III
3 REPLIES 3

Debayan
Databricks Employee
Databricks Employee

As of now there is no way to stop the present cell after a successful run in "run all" scenario.

Additionally, you can always put an error in the cell where you want run all to stop since errors stop "run all".

Also, you can run all cells above and run all cells below. For example: If you want to run all cells up to cell X, go to cell X+1 and “run all cells above”.

image

Vidula
Honored Contributor

Hi there @Peiran Quan​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

CarterM
New Contributor III

@Vidula Khanna​ @Vidula Khanna​ 

We are experiencing the same issue in our Workflows and I was wondering if there has been any update.

We need the functionality to call a method similar to `dbutils.notebook.exit` in a notebook that will cancel the execution of all the following dependent Tasks or the Job as a whole, but this does not seem to exist in Databricks.

For example,

In the following Example Job, if a certain criteria is met in the Task_1 notebook then I want the Example Job to Stop without firing an error. The idea is that we wouldn't have to waste any unnecessary execution in Task_2 and Task_3.

Example Workflow Job 

Is there a way to make a feature request or are there plans to implement this functionality already?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group