One of our databricks workflow job is failing occasionally with below error, after re-running and working fine without any issue.
What is the exact reason for the issue and how can we fix it
Error:
Unexpected failure while waiting for the cluster to be ready: Cluster 'XXX' was terminated. Reason: CLOUD_PROVIDER_LAUNCH_FAILURE (CLOUD_FAILURE). Parameters: azure_error_code:StorageFailure, azure_error_message:Error while creating storage object'