Experiencing the error below in GCP when starting a cluster (both manually and in jobs). It's causing our ETL and other production jobs to fail multiple times a week. Its intermittent, but requires manual intervention to retry scheduled jobs.
run failed with error message Unexpected failure while waiting for the cluster (0817-041248-m827uwd4) to be ready: Cluster 0817-041248-m827uwd4 is in unexpected state Terminating: SECRET_RESOLUTION_ERROR(SERVICE_FAULT): databricks_error_message:Cannot fetch secrets referred in the Spark Environment Variables due to internal error.