topic Re: Internal error message: Failed to launch spark container on instance i-xxxxxxxxxxxxx. Exception: Unexpected internal error, please contact Databricks support in Data Engineering

Internal error message: Failed to launch spark container on instance i-xxxxxxxxxxxxx. Exception: Unexpected internal error, please contact Databricks support

167559 — Tue, 03 Jan 2023 18:38:03 GMT

I have a docker image for debezium in my ECR repo and added IAM roles from Databricks to pull this image for my cluster and seeing this error when cluster is created

Re: Internal error message: Failed to launch spark container on instance i-xxxxxxxxxxxxx. Exception: Unexpected internal error, please contact Databricks support

167559 — Fri, 13 Jan 2023 15:12:01 GMT

I have been trying for more than a week now..... where is the logs for these pulls,....error message is not helpful

Re: Internal error message: Failed to launch spark container on instance i-xxxxxxxxxxxxx. Exception: Unexpected internal error, please contact Databricks support

akdm — Thu, 16 Feb 2023 20:56:59 GMT

If I recall correctly, you'll be able to get better information if you enable logs on the cluster.

Your container probably needs more things installed and you should look through https://github.com/databricks/containers for dependencies. You'd probably need databricksruntime/minimal at a minimum. (If you don't already have it)

Re: Internal error message: Failed to launch spark container on instance i-xxxxxxxxxxxxx. Exception: Unexpected internal error, please contact Databricks support

Debayan — Thu, 05 Jan 2023 19:33:39 GMT

Hi, Could you please retry a few times? This can be an issue with the docker image download. Also, can be a network issue, and also few other possibilities are also there.