Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I have a docker image for debezium in my ECR repo and added IAM roles from Databricks to pull this image for my cluster and seeing this error when cluster is created
Hi, Could you please retry a few times? This can be an issue with the docker image download. Also, can be a network issue, and also few other possibilities are also there.
If I recall correctly, you'll be able to get better information if you enable logs on the cluster.
Your container probably needs more things installed and you should look through https://github.com/databricks/containers for dependencies. You'd probably need databricksruntime/minimal at a minimum. (If you don't already have it)
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
