Databricks cluster launch time
Hi Team,We have an @adf pipeline which will run some set of activities before #Azure databricks notebooks get called.As and when the notebooks are called our pipeline will launch a new cluster for every job with job compute as Standard F4 with a sing...
- 10481 Views
- 3 replies
- 0 kudos
Latest Reply
Hi @Farzana , If the cluster pool has enough idle instances and the slow image download from the artefact storage is not the issue, then a few things can be done to reduce the cluster launch time. Preload the runtime on the instance pool to improve t...
- 0 kudos