You cannot. It is not serializable and not available on a worker. I would recommend that you use the DataFrame APIs. It should be much more performant and there are very limited reasons why RDDs should be used over a DataFrame. Your function looks like it could be converted to a user defined function.