Re: Python UDF vs Scala UDF in pyspark code - Databricks Community

Hi @greyamber ,

Yes, there is a difference. Scala would be faster. You read about the reason and benchmark on following blog:

Spark UDF — Deep Insights in Performance | by QuantumBlack, AI by McKinsey | QuantumBlack, AI by McK...