https://community.databricks.com/t5/data-engineering/how-to-stop-subsequent-iterations-in-databricks-loop-feature/m-p/93599#M38733 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/126180">@surajitDE</a></P><P>Currently, there is no out of the box feature to achieve that. What you can do, is to try to implement notebook logic that in case of error will cancel for each task run using REST API or python sdk:</P><P>-&nbsp;<STRONG>use&nbsp;/api/2.1/jobs/runs/cancel&nbsp;</STRONG>endpoint passing run_id of for_each task that I want to cancel.<BR /><A href="https://docs.databricks.com/api/workspace/jobs/cancelrun" target="_blank" rel="nofollow noopener noreferrer">Cancel a run | Jobs API | REST API reference | Databricks on AWS</A></P><P>&nbsp;</P> Fri, 11 Oct 2024 09:04:35 GMT szymon_dybczak 2024-10-11T09:04:35Z https://community.databricks.com/t5/data-engineering/how-to-stop-subsequent-iterations-in-databricks-loop-feature/m-p/93586#M38732 <P>How to stop subsequent iterations in Databricks loop feature? sys.exit(0) or dbutils.notebook.exit() only marks the current task and series of tasks in sequence as failed, but continues with subsequent iterations.</P> Fri, 11 Oct 2024 07:41:00 GMT https://community.databricks.com/t5/data-engineering/how-to-stop-subsequent-iterations-in-databricks-loop-feature/m-p/93586#M38732 surajitDE 2024-10-11T07:41:00Z https://community.databricks.com/t5/data-engineering/how-to-stop-subsequent-iterations-in-databricks-loop-feature/m-p/93599#M38733 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/126180">@surajitDE</a></P><P>Currently, there is no out of the box feature to achieve that. What you can do, is to try to implement notebook logic that in case of error will cancel for each task run using REST API or python sdk:</P><P>-&nbsp;<STRONG>use&nbsp;/api/2.1/jobs/runs/cancel&nbsp;</STRONG>endpoint passing run_id of for_each task that I want to cancel.<BR /><A href="https://docs.databricks.com/api/workspace/jobs/cancelrun" target="_blank" rel="nofollow noopener noreferrer">Cancel a run | Jobs API | REST API reference | Databricks on AWS</A></P><P>&nbsp;</P> Fri, 11 Oct 2024 09:04:35 GMT https://community.databricks.com/t5/data-engineering/how-to-stop-subsequent-iterations-in-databricks-loop-feature/m-p/93599#M38733 szymon_dybczak 2024-10-11T09:04:35Z