carlafernandez
New Contributor III
In response to MHeemskerk

‎05-03-2023 04:36 AM

Thanks @Martin Heemskerk​ , I think both our options take the same effect. It's a thing in the spark connect session, but it "should" be optional.

Taken from https://github.com/apache/spark/blob/87a5442f7ed96b11051d8a9333476d080054e5a0/python/pyspark/sql/con...

image.pngimage.pngLet's hope they fix it or at least document it

Preview file
37 KB
0 Kudos