Sending R functions to worker nodes

[yopbibo]

Hi!

If I need to use many workers to distributes regular pandas, I would use a pandas_UDF. (having regular python crunching a slice of my data, on each node, and combining all results back to the driver node)

Is there something equivalent for R?

Thanks,

[Kaniz]

Hi @Philippe CRAVE​, Can you please elaborate more on your question - "Is there something equivalent for R"?

[yopbibo]

I am used to work in pyspark.

with pandas_udf.

need to do a notebook in R, so, wonder what is the equivalent to pandas_udf, in sparkR