Hi,

My colleague and I also found that line started running infinitely. We tinkered with the code and did the following to make it work.

1) Remove the following two portions of code:

%sh
wget https://github.com/SeleniumHQ/selenium/releases/download/selenium-4.1.0/selenium-server-4.1.2.jar
mv selenium-server-4.1.2.jar selenium-server.jar

%sh
sudo apt install xvfb
xvfb-run java -D webdriver.chrome.driver=/usr/bin/chromedriver -jar selenium-server.jar

2) Add the following code to the beginning:

%sh
sudo rm -r /var/lib/apt/lists/* 
sudo apt clean && 
  sudo apt update --fix-missing -y &&
  sudo apt install -y  libmysqlclient21
sudo apt install -y gdal-bin

Additionally, fyi, our runtime version of DataBricks is 0.4 LTS (includes Apache Spark 3.2.1, Scala 2.12).

I'm not sure why this works, but hopefully it will fix your issues.

Cheers!