Sending R functions to worker nodes
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-29-2022 12:44 AM
Hi!
If I need to use many workers to distributes regular pandas, I would use a pandas_UDF. (having regular python crunching a slice of my data, on each node, and combining all results back to the driver node)
Is there something equivalent for R?
Thanks,
Labels:
- Labels:
-
Pandas udf
-
Worker Nodes
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-07-2022 01:23 AM
I am used to work in pyspark.
with pandas_udf.
need to do a notebook in R, so, wonder what is the equivalent to pandas_udf, in sparkR
