07-28-2022 05:34 PM
Hello,
I have created and pushed a docker image to Azure Container Registry . I used that image to start the cluster in Databricks. But the cluster doesn't start and as such when I try to run a Databricks' Jon using that Cluster, I get this error below . I made the Cluster using the same credentials used this Databnricks example : https://docs.databricks.com/clusters/custom-containers.html
I would appreciate it if someone could provide some feedback to fix the error.
07-29-2022 01:47 AM
It is an error with pulling containers. Please check vnet/firewall/gateway/port settings and credentials. You can also check the connection to the address using telenet (just run that cluster for the test without docker). To run telnet, you need to use %sh magic command in the notebook cell.
08-02-2022 04:24 AM
hi @Sonia Soleimani the error shows that the failure is because the cluster is unable to download the image. I see the image is stored in azure, have you provided the necessary credentials to access the azure repro? You might need to change the authentication type to use the username and password to pull the image from your private repo. have you tried pushing the image to dockerhub public repo and tried downloading from there?
08-30-2022 09:40 AM
Hi @Sonia Soleimani,
Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
02-14-2023 03:46 AM
Same issue here.
Connection to the container registry seems to work (see screenshot). This connection should go over private endpoints.
Is there anyone who can help me troubleshoot this?
02-14-2023 03:47 AM
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group