saipujari_spark
Databricks Employee
Databricks Employee

Hey @charry 

Look at this KB article, this should help address the issue.

https://kb.databricks.com/execution/spark-serialized-task-is-too-large

Thanks,
Saikrishna Pujari
Sr. Spark Technical Solutions Engineer, Databricks