-werners-
Esteemed Contributor III

mixing python and pyspark often gives issues.

better to go all-in on pandas and then convert to dataframe or go for pyspark (like you did now).

View solution in original post