bplaster
New Contributor II

As of Spark 1.4, you should be able to just:

val new_ddf = ddf.join(up_ddf, "name")

Similar email thread here