cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to exit the entire job in the orchestration scenario?

QPeiran
New Contributor III
3 REPLIES 3

Debayan
Esteemed Contributor III
Esteemed Contributor III

As of now there is no way to stop the present cell after a successful run in "run all" scenario.

Additionally, you can always put an error in the cell where you want run all to stop since errors stop "run all".

Also, you can run all cells above and run all cells below. For example: If you want to run all cells up to cell X, go to cell X+1 and “run all cells above”.

image

Vidula
Honored Contributor

Hi there @Peiran Quan​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

CarterM
New Contributor III

@Vidula Khanna​ @Vidula Khanna​ 

We are experiencing the same issue in our Workflows and I was wondering if there has been any update.

We need the functionality to call a method similar to `dbutils.notebook.exit` in a notebook that will cancel the execution of all the following dependent Tasks or the Job as a whole, but this does not seem to exist in Databricks.

For example,

In the following Example Job, if a certain criteria is met in the Task_1 notebook then I want the Example Job to Stop without firing an error. The idea is that we wouldn't have to waste any unnecessary execution in Task_2 and Task_3.

Example Workflow Job 

Is there a way to make a feature request or are there plans to implement this functionality already?

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!