01-19-2024 12:19 PM
Hi! I was able to successfully download and run selenium on both single and no isolation mode clusters. But the shared cluster do not seem to have permission to access the path of drivers needed such as chrome and chromedriver.
1) what is the general standard to access drivers on clusters with Shared Access mode?
see web exception below:
with single user access or no isolation this works:
01-19-2024 08:26 PM
Hi, could you please refer to https://docs.databricks.com/en/compute/access-mode-limitations.html and let us know if any of the conditions satisfy your situation?
01-22-2024 02:50 PM
Hi @Debayan,
No the article doesnt help with this issue. Have you come across this before?
01-22-2024 07:48 PM
Hi, Is the cluster UC enabled? Also, what are the types of the drivers (chrome and chromedriver) ?
01-24-2024 10:25 AM
Hi Debayan,
No UC is not enabled on the workspace.
01-24-2024 10:28 AM
Also yes - the only drives required are chrome and chromedriver
When accessing them or attempting to do do on a shared cluster this is the error that I get is shown in the image on the first post
(WebDriverException: Message: Can not connect to the Service /databricks/.pyenv/bin/chromedriver)
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group