https://community.databricks.com/t5/machine-learning/sending-r-functions-to-worker-nodes/m-p/33303#M1764 <P>I am used to work in pyspark.</P><P>with pandas_udf.</P><P>need to do a notebook in R, so, wonder what is the equivalent to pandas_udf, in sparkR</P> Wed, 07 Sep 2022 08:23:43 GMT yopbibo 2022-09-07T08:23:43Z https://community.databricks.com/t5/machine-learning/sending-r-functions-to-worker-nodes/m-p/33301#M1762 <P>Hi!</P><P>If I need to use many workers to distributes regular pandas, I would use a pandas_UDF. (having regular python crunching a slice of my data, on each node, and combining all results back to the driver node)</P><P>Is there something equivalent for R?</P><P>Thanks,</P> Mon, 29 Aug 2022 07:44:54 GMT https://community.databricks.com/t5/machine-learning/sending-r-functions-to-worker-nodes/m-p/33301#M1762 yopbibo 2022-08-29T07:44:54Z https://community.databricks.com/t5/machine-learning/sending-r-functions-to-worker-nodes/m-p/33303#M1764 <P>I am used to work in pyspark.</P><P>with pandas_udf.</P><P>need to do a notebook in R, so, wonder what is the equivalent to pandas_udf, in sparkR</P> Wed, 07 Sep 2022 08:23:43 GMT https://community.databricks.com/t5/machine-learning/sending-r-functions-to-worker-nodes/m-p/33303#M1764 yopbibo 2022-09-07T08:23:43Z