topic Re: Databricks rbase container: Rstudio doesn´t work in Data Engineering

Databricks rbase container: Rstudio doesn´t work

francescocamuss — Tue, 14 Sep 2021 18:00:54 GMT

Hello,

How are you? I hope you are doing well!

I´m trying to use a databrick´s image (link: containers/ubuntu/R at master · databricks/containers (github.com)) to run a container when starting a cluster. I need that Rstudio is installed on the container. Although the cluster starts just fine, I can´t acces to Rstudio:

I think that I am meeting the requirements: I disabled table access control, automatic termination, or credential passthrough and I am running the init script specified on the README.md file on github.

Can you help me? Thank you!

Re: Databricks rbase container: Rstudio doesn´t work

francescocamuss — Wed, 15 Sep 2021 12:44:04 GMT

Thank you Kaniz! 🙂

Re: Databricks rbase container: Rstudio doesn´t work

User16873042947 — Mon, 20 Sep 2021 07:56:06 GMT

@Francesco Camussoni : have you tried steps here: https://docs.databricks.com/spark/latest/sparkr/rstudio.html

In the script you have shared, I see you are directly using RSTUDIO_BIN , but I do not see any place where you have downloaded and installed rstudio (required)

To check the result of the init script , enable logging on the cluster, that way you can see the stdout and stderr of the init script from all nodes (note that since $DB_IS_DRIVER is used, the script is expected to run fine only on the driver node and the worker nodes will report failure, this is expected so when you enable logging on the cluster, if you see error that says DB_IS_DRIVER is missing, that just means you are checking worker node log)

Re: Databricks rbase container: Rstudio doesn´t work

francescocamuss — Mon, 25 Oct 2021 17:43:05 GMT

Hi noob, rstudio is installed on the Dockerfile, in fact, the init script I used is specified on databrick's github: containers/ubuntu/R at master · databricks/containers (github.com)

Re: Databricks rbase container: Rstudio doesn´t work

Prabakar — Wed, 10 Nov 2021 17:33:12 GMT

hi @Francesco Camussoni I tested this with the rbase image and yes, I don't see the Rstudio enabled for the cluster.

However, I have built an image that works perfectly with Rstudio.

prabakar2610/rbase14:v2

You can use this image with the init script that you have.

You can find the dockerfile in Github

https://github.com/prabakar2610/Databricks/blob/master/dockerfile

Re: Databricks rbase container: Rstudio doesn´t work

francescocamuss — Wed, 10 Nov 2021 17:56:28 GMT

Hi @Prabakar Ammeappin , thank you a lot for your help! Can you tell me what did you do to solve this problem?

As you said, Rstudio works perfectly but I see that it doesn't work on notebooks, do you know why?

Re: Databricks rbase container: Rstudio doesn´t work

Prabakar — Wed, 10 Nov 2021 18:11:30 GMT

Hi @Francesco Camussoni , I built the image considering the Rstudio app. To use the same image to run commands from a notebook, I might need to add packages that are required to run R commands from the notebook. Let me try to build the image during this week that supports running commands in the notebook as well.

Re: Databricks rbase container: Rstudio doesn´t work

francescocamuss — Wed, 10 Nov 2021 18:17:24 GMT

Thank you a lot! 🙂

Re: Databricks rbase container: Rstudio doesn´t work

Prabakar — Wed, 17 Nov 2021 14:40:15 GMT

Hi @Francesco Camussoni apologies for the delay.

Here is the working image prabakar2610/rbase14:v3

And the dockerfile for the same.

Re: Databricks rbase container: Rstudio doesn´t work

Prabakar — Wed, 24 Nov 2021 17:52:27 GMT

Hi @Francesco Camussoni I wanted to follow on this. Is this image working as expected? And were you able to build your own image using the dockerfile that I shared?

Re: Databricks rbase container: Rstudio doesn´t work

Prabakar — Wed, 24 Nov 2021 17:53:42 GMT

If the issue is resolved would you be happy to mark the answer as best so that others can quickly find the solution in the future.

Re: Databricks rbase container: Rstudio doesn´t work

francescocamuss — Wed, 24 Nov 2021 19:07:46 GMT

Hello @Prabakar Ammeappin , it worked just fine.

Thank you very much!

Re: Databricks rbase container: Rstudio doesn´t work

Prabakar — Wed, 24 Nov 2021 20:33:33 GMT

Hello @Francesco Camussoni Thank you for the confirmation. It would be great if you could mark it as the Best Answer, so the question will be marked as answered and will go on top of the search and benefit other users.