topic Re: Issue with Docker Image connection in Data Engineering

Issue with Docker Image connection

SoniSole — Fri, 29 Jul 2022 00:34:04 GMT

Hello,

I have created and pushed a docker image to Azure Container Registry . I used that image to start the cluster in Databricks. But the cluster doesn't start and as such when I try to run a Databricks' Jon using that Cluster, I get this error below . I made the Cluster using the same credentials used this Databnricks example : https://docs.databricks.com/clusters/custom-containers.html

I would appreciate it if someone could provide some feedback to fix the error.

Re: Issue with Docker Image connection

Hubert-Dudek — Fri, 29 Jul 2022 08:47:30 GMT

It is an error with pulling containers. Please check vnet/firewall/gateway/port settings and credentials. You can also check the connection to the address using telenet (just run that cluster for the test without docker). To run telnet, you need to use %sh magic command in the notebook cell.

Re: Issue with Docker Image connection

Prabakar — Tue, 02 Aug 2022 11:24:27 GMT

hi @Sonia Soleimani the error shows that the failure is because the cluster is unable to download the image. I see the image is stored in azure, have you provided the necessary credentials to access the azure repro? You might need to change the authentication type to use the username and password to pull the image from your private repo. have you tried pushing the image to dockerhub public repo and tried downloading from there?

Re: Issue with Docker Image connection

jose_gonzalez — Tue, 30 Aug 2022 16:40:28 GMT

Hi @Sonia Soleimani,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.

Re: Issue with Docker Image connection

dsfrederic — Tue, 14 Feb 2023 11:46:38 GMT

Same issue here.

Connection to the container registry seems to work (see screenshot). This connection should go over private endpoints.

Is there anyone who can help me troubleshoot this?

Re: Issue with Docker Image connection

dsfrederic — Tue, 14 Feb 2023 11:47:45 GMT

Re: Issue with Docker Image connection

jeremy98 — Tue, 06 May 2025 10:57:34 GMT

We have the same issue, right now. Which is the problem??