- 5864 Views
- 1 replies
- 0 kudos
leaflet not works in notebook(R language)
I saw this notebook: htmlwidgets-azure - Databricks (microsoft.com)However, it is not reproducible. I got a lot errors:there is no package called ‘R.utils’. This is easy to fix, just install the package "R.utils""can not be unloaded". This is not ...
- 5864 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi yalei, Did you have any luck fixing this issue? I am also trying to replicate the htmlwidgets notebook and am running into the same error.Unfortunately, the suggestions provided by Kaniz_Fatma below did not work.
- 0 kudos
- 2139 Views
- 3 replies
- 0 kudos
ODBC Connection to Another Compute Within the Same Workspace
Hello all!I couldn't find anything definitive related to this issue so I hope I'm not duplicating another topic :). I have imported an R repository that normally runs on another machine and uses ODBC driver to issue sparkSQL commands to a compute (le...
- 2139 Views
- 3 replies
- 0 kudos
- 0 kudos
Thanks @Suteja Kanuri for your response! I tried all of the steps you mentioned (and many more) but never managed to make it work. My suspicion was that our azure networking setup was preventing this from happening. I have not found this documented ...
- 0 kudos
- 11111 Views
- 2 replies
- 0 kudos
Combine Python + R in data manipulation in Databricks Notebook
Want to combine Py + Rfrom pyspark.sql import SparkSessionspark = SparkSession.builder.appName("CreateDataFrame").getOrCreate()# Create a sample DataFramedata = [("Alice", 25), ("Bob", 30), ("Charlie", 35), ("Oscar",36), ("Hiromi",41), ("Alejandro", ...
- 11111 Views
- 2 replies
- 0 kudos
- 0 kudos
@Oscar CENTENO MORA :To combine Py and R in a Databricks notebook, you can use the magics command %python and %rto switch between Python and R cells. Here's an example of how to create a Spark DataFrame in Python and then use it in R:from pyspark.sq...
- 0 kudos
- 1963 Views
- 2 replies
- 2 kudos
To collect the elements of a SparkDataFrame and coerces them into an R dataframe.
Hello Everyone,I am facing the challenge while collecting a spark dataframe into an R dataframe, this I need to do as I am using TraMineR algorithm whih is implemented in R only and the data pre-processing I have done in pysparkI am trying this:event...
- 1963 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Niraj Tanwar Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 2 kudos
- 3282 Views
- 1 replies
- 2 kudos
How to display Sparklyr table in a clean readable format similar to the output of display()?
There exist a Databricks’s built-in display() function (see documentation here) which allow users to display R or SparkR dataframe in a clean and human readable manner where user can scroll to see all the columns and perform sorting on the columns. S...
- 3282 Views
- 1 replies
- 2 kudos
- 2 kudos
I found that the display() function returned this issue when it came across date-type fields that were NULL. The following function seemed to fix the problem:library(tidyverse) library(lubridate) display_fixed = function(df) { df %>% ...
- 2 kudos
- 4255 Views
- 5 replies
- 3 kudos
Resolved! Exporting R data frame variable
Hi all.I am trying to export R data frame variable as csv file.I am using this formula:df<- data.frame(VALIDADOR_FIM)df.coalesce(1).write.format("com.databricks.spark.csv").option("header", "true").save("dbfs:/FileStore/df/df.csv")But isn´t working. ...
- 4255 Views
- 5 replies
- 3 kudos
- 3 kudos
Please try to execute write.csv with the following path instead:write.csv(TotalData,file='/dbfs/tmp/df.csv',row.names = FALSE)%fs ls /tmp
- 3 kudos
- 1530 Views
- 0 replies
- 1 kudos
Natively Query Delta Lake with R
I have a large delta table that I need to analyze in native R. The only option I have currently is to query the delta table then use collect() to bring that spark dataframe into an R dataframe. Is there an alternative method that would allow me to qu...
- 1530 Views
- 0 replies
- 1 kudos
- 8266 Views
- 3 replies
- 7 kudos
Resolved! Best language to use
Databricks supports SQL, Scala, Python, and R. Is there a most performant language to use on Databricks? I know SQL well but would like to get into one of the other languages and don't know which to focus on.
- 8266 Views
- 3 replies
- 7 kudos
- 1725 Views
- 2 replies
- 0 kudos
How to install R GeoLift library on Databrickts
Hi, I am having problems installing the GeoLift library. I am proceeding as per the official instructions: https://facebookincubator.github.io/GeoLift/docs/GettingStarted/InstallingRThis is what I run in the notebook:1) I install this particular vers...
- 1725 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Ludmila Kuncarova,I would like to share the following link to our docs https://docs.databricks.com/libraries/notebooks-r-libraries.html in this link you will be able to find more details on how to install R libraries.
- 0 kudos
- 3601 Views
- 6 replies
- 8 kudos
Library Dependency
How to Install Libraries on DatabricksYou can install libraries in Databricks at the cluster level for libraries commonly used on a cluster, at the notebook-level using %pip, or using global init scripts when you have libraries that should be install...
- 3601 Views
- 6 replies
- 8 kudos
- 8 kudos
It can be a risky to install libraries without any sort of oversite/security structure to ensure those libraries have no vulnerabilities. I think more caution needs to be added to the wording of these documents to express that. All of the libraries w...
- 8 kudos
- 1847 Views
- 1 replies
- 6 kudos
Versions of Spark, Python, Scala, R in each Databricks Runtime
What version of Spark, Python, Scala, R are included in each Databricks Runtime? What libraries are pre-installed?You can find this info at the Databricks runtime releases page (AWS | Azure | GCP).Let us know if you have any additional questions on t...
- 1847 Views
- 1 replies
- 6 kudos
- 6 kudos
Wow! Thanks for the help @Isaac Gritz !
- 6 kudos
- 813 Views
- 0 replies
- 0 kudos
How to get notebookid programmatically using R
Hi, I would like to log the notebook id programmatically in R, Is there any command that exists in R so that I can leverage to grab the notebook id, I tried with python using the below command and grab it without any issues, and looking for similar f...
- 813 Views
- 0 replies
- 0 kudos
- 1916 Views
- 1 replies
- 0 kudos
hostinc-logo
Hostinc is the best place to match the price and quality of the product at the most affordable price. If you are looking for a server that can make your marketing campaign a huge success here you go with our one of the most powerful Dedicated Server ...
- 1916 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks for sharing! Before you hire mobile app developers, you need to carefully study this topic.
- 0 kudos
- 4367 Views
- 3 replies
- 1 kudos
How do you install R packages?
I've tried this, but it doesn't appear to be working: https://community.databricks.com/s/question/0D53f00001GHVX1CAP/unable-to-install-sf-and-rgeos-r-packages-on-the-clusterWhen I run the following after that init script, I receive an error.library(r...
- 4367 Views
- 3 replies
- 1 kudos
- 1 kudos
Hey there @Christopher Flach Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear fr...
- 1 kudos
- 1679 Views
- 2 replies
- 1 kudos
Table access control cluster with R language
Hello,I want to have a high concurrency cluster with table access control and I want to use R language on it.I know that the documentation says that R and Scala is not available with table access control.But maybe you have some tricks or best practic...
- 1679 Views
- 2 replies
- 1 kudos
