Intermittent secret resolution error service fault in GCP

cmditch — Thu, 17 Aug 2023 04:26:05 GMT

Experiencing the error below in GCP when starting a cluster (both manually and in jobs). It's causing our ETL and other production jobs to fail multiple times a week. Its intermittent, but requires manual intervention to retry scheduled jobs.

run failed with error message Unexpected failure while waiting for the cluster (0817-041248-m827uwd4) to be ready: Cluster 0817-041248-m827uwd4 is in unexpected state Terminating: SECRET_RESOLUTION_ERROR(SERVICE_FAULT): databricks_error_message:Cannot fetch secrets referred in the Spark Environment Variables due to internal error.

Re: Intermittent secret resolution error service fault in GCP

cmditch — Fri, 18 Aug 2023 18:56:40 GMT

Thanks @Retired_mod . 1 and 2 are confirmed fine. I would imagine 3 to not result in intermittent failures if it were a config issue, but perhaps it's another network related issue that would be susceptible to intermittent failure.

The link you provided is for a training request. Is there another place where I can file a bug report?

topic Intermittent secret resolution error service fault in GCP in Data Engineering

Intermittent secret resolution error service fault in GCP

Re: Intermittent secret resolution error service fault in GCP