I want to be able to access the RDD methods of a Dataframe, but it seems that this is not supported in spark connect. I have been trying to disable spark connect in the spark config using,
spark.databricks.service.server.enabled false
but when I check the type of spark it is still `pyspark.sql.connect.session.SparkSession`. How do I disable spark connect?