https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/19844#M13373 <P>I know that Databricks runs one executor per worker node. </P><P>Can i change the no.of.exectors by adding params (spark.executor.instances) in the cluster advance option? and also can i pass this parameter when i schedule a task, so that particular task will run with that configuration?</P><P></P><P>Is it advisable to modify the executor params like the no.of.instances and memory of executors or we need to go with the default one which is taken care by databricks internally. </P> Tue, 29 Nov 2022 21:28:13 GMT Harun 2022-11-29T21:28:13Z https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/19844#M13373 <P>I know that Databricks runs one executor per worker node. </P><P>Can i change the no.of.exectors by adding params (spark.executor.instances) in the cluster advance option? and also can i pass this parameter when i schedule a task, so that particular task will run with that configuration?</P><P></P><P>Is it advisable to modify the executor params like the no.of.instances and memory of executors or we need to go with the default one which is taken care by databricks internally. </P> Tue, 29 Nov 2022 21:28:13 GMT https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/19844#M13373 Harun 2022-11-29T21:28:13Z https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/19845#M13374 <P>@Harun Raseed Basheer​&nbsp;usually for 1 worker node 1 executor will be there, if we need to split that executor within that worker node itself, we can do that based on memory that core has been assigned , below configs can be use </P><P></P><OL><LI>spark.executor.cores</LI><LI>spark.executor.memory</LI></OL><P></P><P>below article will help you</P><P></P><P><A href="https://kb.databricks.com/clusters/multiple-executors-single-worker.html#:~:text=When%20you%20create%20a%20cluster%2C%20Databricks%20launches%20one,and%20does%20not%20attempt%20to%20run%20concurrent%20tasks." alt="https://kb.databricks.com/clusters/multiple-executors-single-worker.html#:~:text=When%20you%20create%20a%20cluster%2C%20Databricks%20launches%20one,and%20does%20not%20attempt%20to%20run%20concurrent%20tasks." target="_blank">How to configure single-core executors to run JNI libraries - Databricks</A></P><P></P> Wed, 30 Nov 2022 02:09:51 GMT https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/19845#M13374 karthik_p 2022-11-30T02:09:51Z https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/142658#M51996 <P>In Databricks, the executor model is largely managed by the platform itself. On Databricks clusters, each worker node typically runs a single Spark <A href="https://krnlexecutorr.com" target="_self">executor</A>, and this behavior is intentional.</P> Mon, 29 Dec 2025 19:38:15 GMT https://community.databricks.com/t5/data-engineering/how-to-change-the-number-of-executors-instances-in-databricks/m-p/142658#M51996 RandiMacGyver 2025-12-29T19:38:15Z