init_script error during cluster creation - 101: Network is unreachable

[Serhii]

When I run the init_script during cluster creation

apt-get update && apt-get install -y ffmpeg libsndfile1-dev

I get an error in cluster logs

E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/universe/o/openal-soft/libopenal1_1.19.1-1_amd64.deb  Cannot initiate the connection to archive.ubuntu.com:80 (2620:2d:4000:1::16). - connect (101: Network is unreachable) Cannot initiate the connection to archive.ubuntu.com:80 (2620:2d:4000:1::19). - connect (101: Network is unreachable) Cannot initiate the connection to archive.ubuntu.com:80 (2001:67c:1562::15). - connect (101: Network is unreachable) Cannot initiate the connection to archive.ubuntu.com:80 (2001:67c:1562::18). - connect (101: Network is unreachable)

Any suggestions how to fix it would be most appreciated

[Hubert-Dudek · Accepted solution]

Please check routing in managed vpc. It seems that traffic out is blocked.

You can also, in the notebook, run that command to diagnose connection issues as maybe it is only during init scripts:

%sh
nc -zv archive.ubuntu.com 443

[Anonymous]

Hi @Sergii Ivakhno​ ,

Looks like the outbound connection could not be established. Please check the outbound access in the security group and egress traffic in the route table.

[Serhii]

Thanks for reply - strangely I only notice this error with apt-get. For example pip install works correctly so not sure if it's networking issues (unless pip works with Databricks-hosted mirror).

[Anonymous]

Hi @Sergii Ivakhno​ Could you please check if outbound TCP access for port 80 is allowed in the security group.