https://community.databricks.com/t5/data-engineering/is-it-safe-to-turn-off-pre-emption-on-an-on-demand-cluster/m-p/19204#M12848 Fri, 25 Jun 2021 17:48:14 GMT brickster_2018 2021-06-25T17:48:14Z https://community.databricks.com/t5/data-engineering/is-it-safe-to-turn-off-pre-emption-on-an-on-demand-cluster/m-p/19204#M12848 Fri, 25 Jun 2021 17:48:14 GMT https://community.databricks.com/t5/data-engineering/is-it-safe-to-turn-off-pre-emption-on-an-on-demand-cluster/m-p/19204#M12848 brickster_2018 2021-06-25T17:48:14Z https://community.databricks.com/t5/data-engineering/is-it-safe-to-turn-off-pre-emption-on-an-on-demand-cluster/m-p/19205#M12849 <P>Pre-emption is by default turned on Databricks cluster. Turning on or turning off pre-emption would make more sense on a high concurrency cluster. Pre-emption ensures that the job starting for resources gets a fair share of the resource available on the cluster. To make the resources available, pre-emption would kill the running tasks.&nbsp;</P><P></P><P>To answer the question, as there are no concurrent jobs on an on-demand cluster, it would not make much difference if the pre-emption is enabled or disabled. In case if there are concurrent jobs submitted using internal application logic, then there will be an impact.&nbsp;</P><P></P> Fri, 25 Jun 2021 17:48:35 GMT https://community.databricks.com/t5/data-engineering/is-it-safe-to-turn-off-pre-emption-on-an-on-demand-cluster/m-p/19205#M12849 brickster_2018 2021-06-25T17:48:35Z