topic Re: How can I exit from a Notebook which is used as a job? in Data Engineering

How can I exit from a Notebook which is used as a job?

User16301465121 — Sat, 18 Apr 2015 15:21:24 GMT

How can I quit from a notebook in the middle of an execution based on some condition?

Re: How can I exit from a Notebook which is used as a job?

arsalan1 — Mon, 18 May 2015 05:46:23 GMT

@Mohan Kolli

The simple way to terminate execution based on a condition is to throw an exception; doing so will cause the run to terminate immediately. However, doing so will also cause the job to have a 'Failed' status.

In order to to maintain correctness semantics, you'd need to wrap each command in in a Try/Catch clause, and if the particular condition is met to simply perform a No-Op so that the run will complete successfully.

Re: How can I exit from a Notebook which is used as a job?

Josh — Tue, 08 Jan 2019 14:26:50 GMT

This does not work. When I have a cell (I am using pyspark) that has the command:

quit()

Databricks skips over that particular cell,but still runs the next cell.

Re: How can I exit from a Notebook which is used as a job?

SamsonXia — Tue, 28 May 2019 18:32:20 GMT

exit(value: String): void

Calling

dbutils.notebook.exit

in a job causes the notebook to complete successfully. If you want to cause the job to fail, throw an exception.