https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20502#M13838 <P>There is a hard limit of 145 active execution contexts on a Cluster. This is to ensure the cluster is not overloaded with too many parallel threads starving for resources. </P><P>The limit is not configurable. If there are more than 145 parallel jobs to be executed, its strongly recommended to create a new cluster </P> Thu, 24 Jun 2021 17:33:21 GMT brickster_2018 2021-06-24T17:33:21Z https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20501#M13837 <P>Is there a limit on it and&nbsp;is the limit configurable?</P> Thu, 24 Jun 2021 17:31:10 GMT https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20501#M13837 brickster_2018 2021-06-24T17:31:10Z https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20502#M13838 <P>There is a hard limit of 145 active execution contexts on a Cluster. This is to ensure the cluster is not overloaded with too many parallel threads starving for resources. </P><P>The limit is not configurable. If there are more than 145 parallel jobs to be executed, its strongly recommended to create a new cluster </P> Thu, 24 Jun 2021 17:33:21 GMT https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20502#M13838 brickster_2018 2021-06-24T17:33:21Z https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20503#M13839 <P>I would like to know where I can find the number of active execution contexts on a cluster, Can you please suggest?</P> Wed, 15 Jun 2022 10:29:32 GMT https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20503#M13839 veera558 2022-06-15T10:29:32Z https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20504#M13840 <P>Is it depend on the cluster size? If yes, what is the appropriate cluster configuration we are talking here. </P> Fri, 16 Sep 2022 03:40:54 GMT https://community.databricks.com/t5/data-engineering/how-many-notebooks-jobs-can-i-run-in-parallel-on-a-databricks/m-p/20504#M13840 Saurabh98290 2022-09-16T03:40:54Z