That fixes it. Thanks. I need to do

spark = SparkSession.builder.getOrCreate()

df = spark.table("prod.some_schema.some_table")

instead of

sc = SparkSession.builder.getOrCreate()

   sqlc = SQLContext(sc)

   df = sqlc.table(f"prod.some_schema.some_table")