https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33654#M24604 <P>Hi,</P><P></P><P>I also use azue data factory to run databricks notebook as with data factory you can nice handle many data flow scenarios depend on task success/failure/completion/timeout etc. -- Can't we implement this type of scenario in Databricks using Multiple tasks job.</P><P></P><P>Thank you</P> Wed, 08 Dec 2021 06:11:47 GMT SailajaB 2021-12-08T06:11:47Z https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33650#M24600 <P>how to set retry attempt in the data bricks notebook in term of like if any cmd /cell get fails that times that particular cmd/cell should be rerun for purpose of connection issue etc.</P> Tue, 07 Dec 2021 10:57:58 GMT https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33650#M24600 Siddhesh2525 2021-12-07T10:57:58Z https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33651#M24601 <UL><LI>you can just implement try/except in cell, handling it by using dbutils.notebook.exit(jobId) and using other dbutils can help,</LI><LI>when job fail you can specify your email to get job alerts,</LI></UL><P><span class="lia-inline-image-display-wrapper" image-alt="image.png"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2252iD7816717A8E91141/image-size/large?v=v2&amp;px=999" role="button" title="image.png" alt="image.png" /></span></P><UL><LI>additionally if notebook job fail you can specify retry in job task settings</LI></UL><P><span class="lia-inline-image-display-wrapper" image-alt="image.png"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2243iD6D07B298871F44A/image-size/large?v=v2&amp;px=999" role="button" title="image.png" alt="image.png" /></span></P> Tue, 07 Dec 2021 11:12:02 GMT https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33651#M24601 Hubert-Dudek 2021-12-07T11:12:02Z https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33652#M24602 <UL><LI> "you can just implement try/except in cell, handling it by using dbutils.notebook.exit(jobId) and using other dbutils can help,</LI></UL><P></P><P></P><P>@<A href="https://community.databricks.com/s/profile/0053f000000WW82AAG" alt="https://community.databricks.com/s/profile/0053f000000WW82AAG" target="_blank">HubertDudek</A> As i am fresher in the databricks ,Could you please suggest /explain me in detail </P><P></P> Tue, 07 Dec 2021 11:26:57 GMT https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33652#M24602 Siddhesh2525 2021-12-07T11:26:57Z https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33653#M24603 <P><A href="https://docs.databricks.com/notebooks/notebook-workflows.html" target="test_blank">https://docs.databricks.com/notebooks/notebook-workflows.html</A></P><P></P><P>dbutils.notebook.run() - run other notebook from main notebook</P><P>dbutils.notebook.exit("failed") - quit notebook and can return status to main notebook (it can be in except block)</P><P></P><P>With all this command you can implement any own logic.</P><P>I also use azue data factory to run databricks notebook as with data factory you can nice handle many data flow scenarios depend on task success/failure/completion/timeout etc.</P> Tue, 07 Dec 2021 12:36:44 GMT https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33653#M24603 Hubert-Dudek 2021-12-07T12:36:44Z https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33654#M24604 <P>Hi,</P><P></P><P>I also use azue data factory to run databricks notebook as with data factory you can nice handle many data flow scenarios depend on task success/failure/completion/timeout etc. -- Can't we implement this type of scenario in Databricks using Multiple tasks job.</P><P></P><P>Thank you</P> Wed, 08 Dec 2021 06:11:47 GMT https://community.databricks.com/t5/data-engineering/how-to-set-retry-attempt-and-how-to-set-email-alert-with-error/m-p/33654#M24604 SailajaB 2021-12-08T06:11:47Z