topic Re: How to request the addition of pre-installed R packages on the clusters? in Machine Learning

How to request the addition of pre-installed R packages on the clusters?

mbaumga — Fri, 16 Jun 2023 13:07:02 GMT

Today, many R packages are pre-installed on the standard clusters on Databricks. Libraries like "tidyverse", "ggplot2", etc are there. Also the great library "readxl" to load Excel files. But unfortunately, its counterpart "writexl" is not pre-installed. This means I need to install it whenever I run a notebook, as I don't want to install library on my cluster, as only a few notebooks use this library. How can I request libraries like "writexl" to be installed by default? Then please also install "igraph", "htmlwidgets", "htmltools", ... .

Re: How to request the addition of pre-installed R packages on the clusters?

-werners- — Fri, 16 Jun 2023 14:11:27 GMT

https://docs.databricks.com/resources/ideas.html

No guarantee it will be added though.

Re: How to request the addition of pre-installed R packages on the clusters?

karthik_p — Fri, 16 Jun 2023 14:19:47 GMT

@Marcel Baumgartner you can install notebook scoped, they are specific to notebook and particular session.

you can install by using %pip install <library name that you are going to install>

Re: How to request the addition of pre-installed R packages on the clusters?

Anonymous — Sun, 18 Jun 2023 09:48:20 GMT

Hi @Marcel Baumgartner

We haven't heard from you since the last response from @Werner Stinckens , and @karthik p , and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Re: How to request the addition of pre-installed R packages on the clusters?

mbaumga — Mon, 19 Jun 2023 05:37:43 GMT

I know, but that's what I want to avoid, as it always takes a lot of time.

Re: How to request the addition of pre-installed R packages on the clusters?

mbaumga — Mon, 19 Jun 2023 05:38:36 GMT

This is not really an idea, or a new feature.. I just need to figure who decides which R packages are pre-installed on the cluster.

Re: How to request the addition of pre-installed R packages on the clusters?

Anonymous — Tue, 27 Jun 2023 10:51:01 GMT

I still don't have a satisfying answer. Any other suggestions from the community?

Re: How to request the addition of pre-installed R packages on the clusters?

wicckkjoe — Tue, 27 Jun 2023 11:40:22 GMT

I just need to figure who decides which R packages are pre-installed on the cluster.