cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Issue with Docker Image connection

SoniSole
New Contributor II

Hello,

I have created and pushed a docker image to Azure Container Registry . I used that image to start the cluster in Databricks. But the cluster doesn't start and as such when I try to run a Databricks' Jon using that Cluster, I get this error below . I made the Cluster using the same credentials used this Databnricks example : https://docs.databricks.com/clusters/custom-containers.html

I would appreciate it if someone could provide some feedback to fix the error.

image

5 REPLIES 5

Hubert-Dudek
Esteemed Contributor III

It is an error with pulling containers. Please check vnet/firewall/gateway/port settings and credentials. You can also check the connection to the address using telenet (just run that cluster for the test without docker). To run telnet, you need to use %sh magic command in the notebook cell.

Prabakar
Databricks Employee
Databricks Employee

hi @Sonia Soleimani​ the error shows that the failure is because the cluster is unable to download the image. I see the image is stored in azure, have you provided the necessary credentials to access the azure repro? You might need to change the authentication type to use the username and password to pull the image from your private repo. have you tried pushing the image to dockerhub public repo and tried downloading from there?

jose_gonzalez
Databricks Employee
Databricks Employee

Hi @Sonia Soleimani​,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.

dsfrederic
New Contributor II

Same issue here.

Connection to the container registry seems to work (see screenshot). This connection should go over private endpoints.

Is there anyone who can help me troubleshoot this?

dsfrederic
New Contributor II

CleanShot 2023-02-14 at 12.43.00

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group