I got the same error when I save my dataframe to S3,
Although other DataFrame can save successfully.
I found a method to avoid the problem in my case.
.
Define a function to save the DataFrame to hdfs first,
and then use the saved parquet file creat...