topic Re: init_script error during cluster creation - 101: Network is unreachable in Data Engineering

init_script error during cluster creation - 101: Network is unreachable

Serhii — Wed, 30 Mar 2022 21:56:33 GMT

When I run the init_script during cluster creation

apt-get update && apt-get install -y ffmpeg libsndfile1-dev

I get an error in cluster logs

E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/universe/o/openal-soft/libopenal1_1.19.1-1_amd64.deb  Cannot initiate the connection to archive.ubuntu.com:80 (2620:2d:4000:1::16). - connect (101: Network is unreachable) Cannot initiate the connection to archive.ubuntu.com:80 (2620:2d:4000:1::19). - connect (101: Network is unreachable) Cannot initiate the connection to archive.ubuntu.com:80 (2001:67c:1562::15). - connect (101: Network is unreachable) Cannot initiate the connection to archive.ubuntu.com:80 (2001:67c:1562::18). - connect (101: Network is unreachable)

Any suggestions how to fix it would be most appreciated

Re: init_script error during cluster creation - 101: Network is unreachable

Hubert-Dudek — Wed, 30 Mar 2022 22:56:22 GMT

Please check routing in managed vpc. It seems that traffic out is blocked.

You can also, in the notebook, run that command to diagnose connection issues as maybe it is only during init scripts:

%sh
nc -zv archive.ubuntu.com 443

Re: init_script error during cluster creation - 101: Network is unreachable

Anonymous — Sun, 03 Apr 2022 19:01:41 GMT

Hi @Sergii Ivakhno ,

Looks like the outbound connection could not be established. Please check the outbound access in the security group and egress traffic in the route table.

Re: init_script error during cluster creation - 101: Network is unreachable

Serhii — Mon, 04 Apr 2022 09:13:41 GMT

Thanks for reply - strangely I only notice this error with apt-get. For example pip install works correctly so not sure if it's networking issues (unless pip works with Databricks-hosted mirror).

Re: init_script error during cluster creation - 101: Network is unreachable

Anonymous — Mon, 04 Apr 2022 09:58:39 GMT

Hi @Sergii Ivakhno Could you please check if outbound TCP access for port 80 is allowed in the security group.