cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Gray
by Contributor
  • 14711 Views
  • 26 replies
  • 19 kudos

Resolved! Errors Using Selenium/Chromedriver in DataBricks

Hello,I’m programming in a notebook and attempting to use the python library Selenium to automate Chrome/chromedriver. I’ve successfully managed to install selenium using%sh  pip install seleniumI then attempt the following code, which results in the...

  • 14711 Views
  • 26 replies
  • 19 kudos
Latest Reply
aa_204
New Contributor II
  • 19 kudos

I also tried the script and am getting similar error. Can anyone please give some resolution for it?Error in Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/s/systemd/udev_245.4-4ubuntu3.18_amd64.deb and Unable to fetch some archives

  • 19 kudos
25 More Replies
ranged_coop
by Valued Contributor II
  • 7533 Views
  • 24 replies
  • 29 kudos

How to install Chromium Browser and Chrome Driver on DBX runtime 10.4 and above ?

Hi Team,We are wondering if there is a recommended way to install the chromium browser and chrome driver on Databricks Runtime 10.4 and above ?I have been through the site and have come across several links to this effect, but they all seem to be ins...

  • 7533 Views
  • 24 replies
  • 29 kudos
Latest Reply
Kaizen
Contributor
  • 29 kudos

Look into Playwrite instead of Selenium. I went through the same process y'all went through here (ended up writing a init script to install the drivers etc)This is all done for you in playwright. Refer to this post - I hope it helps!!https://communit...

  • 29 kudos
23 More Replies
AJ270990
by Contributor II
  • 5857 Views
  • 5 replies
  • 6 kudos

Resolved! ChromeDriver installation in Databricks

I am working on a Webscraping logic and need to install Chrome driver. How can I install it in the Databricks workbook ?

  • 5857 Views
  • 5 replies
  • 6 kudos
Latest Reply
Evan_MCK
Contributor
  • 6 kudos

What worked for me was downloading the chrome driver and ensuring its the latest version with shell scripts in the same notebook I used for web scraping. You can see all the details here: https://stackoverflow.com/questions/69192050/using-selenium-...

  • 6 kudos
4 More Replies
Tripalink
by New Contributor III
  • 2656 Views
  • 2 replies
  • 0 kudos

Using Selenium Chrome Driver in Databricks, runs the first time but fails after that

I have a notebook that uses a Selenium Web Driver for Chrome and it works the first time I run the notebook. If I run the notebook again, it will not work and gives the error message: WebDriverException: Message: unknown error: unable to discover op...

  • 2656 Views
  • 2 replies
  • 0 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 0 kudos

Hi, @Dagart Allison​ . I've created a new version of the selenium with the databricks manual. Please look here https://community.databricks.com/s/feed/0D58Y00009SWgVuSAL

  • 0 kudos
1 More Replies
Labels