Through pip install gaphframes the version is 0.6 which is only supported by 2.x versions of Spark. For the latest versions of graphframes use: pip install graphframes-py. This, as of today, gets the version 0.9.2 which is fully compatible with Spark versions 3.5+

You can see the differences here between these two pip install commands:

pip install graphframes

pip install graphframes-py