Aviral-Bhardwaj
Esteemed Contributor III

its seems that when your nodes are increasing it is seeking for init script and it is failing so you can use reserve instances for this activity instead of spot instances

it will increase your overall cost

or alternatively, you can use depended library option in the databricks,may be this way you can solve this situation

AviralBhardwaj