https://community.databricks.com/t5/data-engineering/why-not-enable-quot-decommissioning-quot-in-spark/m-p/52879#M29644 <P>You can <A href="https://learn.microsoft.com/nb-no/azure/databricks/clusters/clusters-manage#decommission" target="_self">enable</A> "decommissioning" in spark, which causes it to remove work from a worker when it gets a notification from the cloud that the instance goes away (e.g. SPOT instances). This is dissabled by default, but it seems like such a no-brainer to activate.</P><P>So: Why is it not enabled by default in databricks, and is there any downside to enabling it?</P><P>&nbsp;</P> Sat, 18 Nov 2023 15:24:10 GMT Erik 2023-11-18T15:24:10Z https://community.databricks.com/t5/data-engineering/why-not-enable-quot-decommissioning-quot-in-spark/m-p/52879#M29644 <P>You can <A href="https://learn.microsoft.com/nb-no/azure/databricks/clusters/clusters-manage#decommission" target="_self">enable</A> "decommissioning" in spark, which causes it to remove work from a worker when it gets a notification from the cloud that the instance goes away (e.g. SPOT instances). This is dissabled by default, but it seems like such a no-brainer to activate.</P><P>So: Why is it not enabled by default in databricks, and is there any downside to enabling it?</P><P>&nbsp;</P> Sat, 18 Nov 2023 15:24:10 GMT https://community.databricks.com/t5/data-engineering/why-not-enable-quot-decommissioning-quot-in-spark/m-p/52879#M29644 Erik 2023-11-18T15:24:10Z