โ02-27-2024 08:35 AM
Why might this be erroring out? My understanding is that SparkR is built into Databricks.
Code:
โ02-27-2024 08:46 AM
@Flachboard84 - could you please try the below code ?
library(SparkR, include.only=c('read.parquet', 'collect'))
sparkR.session() is not required on the databricks notebook. This should be handled automatically.
Reference: https://docs.databricks.com/en/sparkr/overview.html
โ02-27-2024 09:03 AM
Thanks for the reply!
Now I'm getting this:
Warning in sparkR.callJMethod(SparkR:::getSparkContext(), "setLocalProperty", : could not find function "sparkR.callJMethod"
โ02-27-2024 09:25 AM
@Flachboard84 - could you please share the associated code?
โ02-27-2024 09:33 AM
It happens with any code; even something as simple as...
x <- 2 + 2
never-displayed
Excited to expand your horizons with us? Click here to Register and begin your journey to success!
Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!