cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

How to request the addition of pre-installed R packages on the clusters?

mbaumga
New Contributor III

Today, many R packages are pre-installed on the standard clusters on Databricks. Libraries like "tidyverse", "ggplot2", etc are there. Also the great library "readxl" to load Excel files. But unfortunately, its counterpart "writexl" is not pre-installed. This means I need to install it whenever I run a notebook, as I don't want to install library on my cluster, as only a few notebooks use this library. How can I request libraries like "writexl" to be installed by default? Then please also install "igraph", "htmlwidgets", "htmltools", ... .

7 REPLIES 7

-werners-
Esteemed Contributor III

https://docs.databricks.com/resources/ideas.html

No guarantee it will be added though.

mbaumga
New Contributor III

This is not really an idea, or a new feature.. I just need to figure who decides which R packages are pre-installed on the cluster.

karthik_p
Esteemed Contributor

@Marcel Baumgartner​ you can install notebook scoped, they are specific to notebook and particular session.

you can install by using %pip install <library name that you are going to install>

mbaumga
New Contributor III

I know, but that's what I want to avoid, as it always takes a lot of time.

Anonymous
Not applicable

Hi @Marcel Baumgartner​ 

We haven't heard from you since the last response from @Werner Stinckens​ , and @karthik p​ ​, and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others. 

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

mbaumga1
New Contributor II

I still don't have a satisfying answer. Any other suggestions from the community?

wicckkjoe
New Contributor II

I just need to figure who decides which R packages are pre-installed on the cluster.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.