I used spark.read.parquet and then convereted that to pandas dataframe and it worked for me.
Upvote if it helped you.
I used spark.read.parquet and then convereted that to pandas dataframe and it worked for me.
Upvote if it helped you.