topic Re: Using Python RPA Library on Databricks in Get Started Discussions

Using Python RPA Library on Databricks

Kaizen — Wed, 31 Jan 2024 23:29:56 GMT

Hi I didn't see any conversations regarding using python RPA package on Data bricks clusters. Is anyone doing this or have gotten it to successfully work on the clusters?

I ran into the following errors:

1) Initially I was getting the error below regarding init(). However this was due to not having chrome driver installed

2) After installing chrome driver. The cell now hangs without erroring out. This is really interesting. Any suggestions or thoughts would be welcome.

Re: Using Python RPA Library on Databricks

feiyun0112 — Thu, 01 Feb 2024 02:56:20 GMT

If you want to capture browser screenshot, you can use playwright

%sh pip install playwright playwright install sudo apt-get update playwright install-deps

from playwright.async_api import async_playwright async with async_playwright() as p: browser = await p.chromium.launch() page = await browser.new_page() await page.goto("https://google.com") await page.screenshot(path="results.png", full_page=True) await browser.close()

Re: Using Python RPA Library on Databricks

Kaizen — Mon, 05 Feb 2024 23:00:41 GMT

Thanks for the suggestion @feiyun0112. This works great!!! Will also post this on some of the selenium forms on DB since this might be easier/better suited for what they are doing (without having to manage an init script and doing the driver installs manually)

How are you running it on a individual/no isolation cluster? This wont work on the shared cluster.

Likely due to accessing the paths of the browser driver. Ran into the same issue with Selenium