Hi @willflwrs 

I'm experiencing the same thing, how to set this up spark.conf.set("spark.sql.legacy.charVarcharAsString", True?