We are trying to write the data frame to s3 using:

df.write.mode('overwrite').save("s3://BUCKET-NAME/temp"), but recently we are getting the following error:

'com.amazonaws.services.s3.model.MultiObjectDeleteException: One or more objects could not be deleted'