06-16-2023 06:07 AM
Today, many R packages are pre-installed on the standard clusters on Databricks. Libraries like "tidyverse", "ggplot2", etc are there. Also the great library "readxl" to load Excel files. But unfortunately, its counterpart "writexl" is not pre-installed. This means I need to install it whenever I run a notebook, as I don't want to install library on my cluster, as only a few notebooks use this library. How can I request libraries like "writexl" to be installed by default? Then please also install "igraph", "htmlwidgets", "htmltools", ... .
06-16-2023 07:11 AM
https://docs.databricks.com/resources/ideas.html
No guarantee it will be added though.
06-18-2023 10:38 PM
This is not really an idea, or a new feature.. I just need to figure who decides which R packages are pre-installed on the cluster.
06-16-2023 07:19 AM
@Marcel Baumgartner you can install notebook scoped, they are specific to notebook and particular session.
you can install by using %pip install <library name that you are going to install>
06-18-2023 10:37 PM
I know, but that's what I want to avoid, as it always takes a lot of time.
06-18-2023 02:48 AM
Hi @Marcel Baumgartner
We haven't heard from you since the last response from @Werner Stinckens , and @karthik p , and I was checking back to see if her suggestions helped you.
Or else, If you have any solution, please share it with the community, as it can be helpful to others.
Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.
06-27-2023 03:51 AM
I still don't have a satisfying answer. Any other suggestions from the community?
06-27-2023 04:40 AM
I just need to figure who decides which R packages are pre-installed on the cluster.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group