Hi @cmditch, Based on the error message, the issue seems to be related to the resolution of secrets referred to in the Spark Environment Variables.
This error indicates that there is an internal error when fetching these secrets.
Here are a few potential causes and solutions:
1. **Permissions**: The Service Account (SA) used by your Databricks workspace might not have the correct permissions to access the secrets. Ensure the SA has the necessary permissions, such as’ Compute Storage Admin',’ Databricks Service IAM Role for Workspace’, and’ Kubernetes Engine Admin’.
2. **Secret Existence**: The secrets referred to in the Spark Environment Variables might not exist or have been deleted. Verify that these secrets exist and are correctly configured.
3. **Internal Connectivity Issues**: Internal network connectivity issues might prevent the secrets from being fetched. Check your network configuration and ensure that there is proper connectivity.
Unfortunately, providing a more specific solution without more detailed logs or information about your setup is challenging. If the problem persists, consider contacting Databricks support by filing a support ticket here.