cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

How can I exit from a Notebook which is used as a job?

User16301465121
New Contributor

How can I quit from a notebook in the middle of an execution based on some condition?

3 REPLIES 3

arsalan1
Contributor

@Mohan Kolli

The simple way to terminate execution based on a condition is to throw an exception; doing so will cause the run to terminate immediately. However, doing so will also cause the job to have a 'Failed' status.

In order to to maintain correctness semantics, you'd need to wrap each command in in a Try/Catch clause, and if the particular condition is met to simply perform a No-Op so that the run will complete successfully.

Josh
New Contributor II

This does not work. When I have a cell (I am using pyspark) that has the command:

quit()

Databricks skips over that particular cell,but still runs the next cell.

SamsonXia
New Contributor II

exit(value: String): void

Calling

dbutils.notebook.exit

in a job causes the notebook to complete successfully. If you want to cause the job to fail, throw an exception.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.