cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

404 Not Found [IP: 185.125.190.36 80] on trying to install google-chrome in databricks spark driver

sid_de
New Contributor II

We are installing google-chrome-stable in databricks cluster using apt-get install. Which has been working fine for a long time, but since the past few days it has started to fail intermittently.

The following is the code that we run.

%sh 
sudo curl -sS -o - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add
 sudo echo "deb https://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google-chrome.list 
sudo apt-get -y update 
sudo apt-get -y --fix-missing install google-chrome-stable

The following is the error we see.

After this operation, 329 MB of additional disk space will be used.
Err:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 udev amd64 245.4-4ubuntu3.18
  404  Not Found [IP: 185.125.190.39 80]
Unable to correct missing packages.
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/google-chrome.list:1 and /etc/apt/sources.list.d/google-chrome.list:2
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/google-chrome.list:1 and /etc/apt/sources.list.d/google-chrome.list:2
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/google-chrome.list:1 and /etc/apt/sources.list.d/google-chrome.list:3
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/google-chrome.list:1 and /etc/apt/sources.list.d/google-chrome.list:3
W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/google-chrome.list:1 and /etc/apt/sources.list.d/google-chrome.list:4
W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/google-chrome.list:1 and /etc/apt/sources.list.d/google-chrome.list:4
E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/s/systemd/udev_245.4-4ubuntu3.18_amd64.deb  404  Not Found [IP: 185.125.190.39 80]
E: Aborting install.

was trying to reinstall the package if failure occured using the follow code

%sh
i=0
while true;
echo "inside while loop"
sudo add-apt-repository --remove ppa:vikoadi/ppa
sudo apt-get -y --fix-missing install google-chrome-stable
do
if [ $(google-chrome --version| grep -c "Google Chrome") -gt 0 ]; then
     echo "chrome installed"
     break;
  else
     echo "chrome not installed trying another attempt"
     echo "sleeping"
     sleep 10000
fi
i=$((i+1))
if [ i -gt 3]; then
  echo "max attempts tried"
  break;
fi
done

But the above logic did not work because - while loop breaks on installation failure.

Any help would be appreciated

2 REPLIES 2

Hubert-Dudek
Esteemed Contributor III

If you want to set up Selenium please take a look at my article https://community.databricks.com/s/feed/0D58Y00009SWgVuSAL but as things again changed please look also at Gray post https://community.databricks.com/s/question/0D58Y00009PlBaaSAF/errors-using-seleniumchromedriver-in-...

sid_de
New Contributor II

Hi

The issue was still persistent. We are trying to solve this by using docker image with preinstalled Selenium driver and chrome browser.

Regards

Dharmin

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group