Enable to use library GraphFrames

sachamourier
Contributor

Hello,

I am trying to install and use the library GraphFrames but keep receiving the following error: "AttributeError: 'SparkSession' object has no attribute '_sc'".

I have tried to install the library on my all-purpose cluster (Access mode: Standard). The installation works, but the code not. I am using the library version "graphframes:graphframes:0.8.4-spark3.5-s_2.13" and my spark version is 3.5.2.
I have also tried to install the library via pip install but no success either.

Does anyone know how to make it work ? I would like to avoid having to change my cluster's access mode.

Thanks a lot,

Sacha