sher
Valued Contributor II

don't use python normal function use UDF in pyspark so that will be faster