https://community.databricks.com/t5/get-started-discussions/facing-issue-with-databricks-context-limit-exceeded/m-p/74999#M7532 <P>We have a use case , where there may be chance of 200 jobs executing at once. But Few notebooks are failing with an issue "<SPAN>run failed with error message Too many execution contexts are open right now.(Limit set currently to 150)." Can anyone help how to solve this?</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="ganemouni_0-1718803036914.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8812i8EA6B58CD07E4E98/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="ganemouni_0-1718803036914.png" alt="ganemouni_0-1718803036914.png" /></span></P><P>&nbsp;</P> Wed, 19 Jun 2024 13:17:45 GMT ganemouni 2024-06-19T13:17:45Z https://community.databricks.com/t5/get-started-discussions/facing-issue-with-databricks-context-limit-exceeded/m-p/74999#M7532 <P>We have a use case , where there may be chance of 200 jobs executing at once. But Few notebooks are failing with an issue "<SPAN>run failed with error message Too many execution contexts are open right now.(Limit set currently to 150)." Can anyone help how to solve this?</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="ganemouni_0-1718803036914.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8812i8EA6B58CD07E4E98/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="ganemouni_0-1718803036914.png" alt="ganemouni_0-1718803036914.png" /></span></P><P>&nbsp;</P> Wed, 19 Jun 2024 13:17:45 GMT https://community.databricks.com/t5/get-started-discussions/facing-issue-with-databricks-context-limit-exceeded/m-p/74999#M7532 ganemouni 2024-06-19T13:17:45Z https://community.databricks.com/t5/get-started-discussions/facing-issue-with-databricks-context-limit-exceeded/m-p/75047#M7533 <P>Hello, you can refer to the following KB article for information and best practices in regards the issue you are facing: <A href="https://kb.databricks.com/en_US/notebooks/too-many-execution-contexts-are-open-right-now" target="_blank">https://kb.databricks.com/en_US/notebooks/too-many-execution-contexts-are-open-right-now</A>&nbsp;<BR /><BR /></P> <H2 id="best-practices" data-toc="true">Best practices</H2> <UL> <LI>Use a job cluster instead of an interactive cluster. A job cluster for each job is the best way to avoid running out of execution contexts. Job clusters should be used for isolation and reliability.</LI> <LI>Reduce the number of separate notebooks used to reduce the number of execution contexts required.</LI> </UL> Wed, 19 Jun 2024 19:04:49 GMT https://community.databricks.com/t5/get-started-discussions/facing-issue-with-databricks-context-limit-exceeded/m-p/75047#M7533 Walter_C 2024-06-19T19:04:49Z