Re: get a "Py4JJavaError: An error occurred while ...

laus · ‎03-31-2022

Hi,

I'm trying to save a dataframe to csv with the code below:

output.coalesce(1).write.mode('overwrite').option('header', 'true').csv(tmp_file_path)

But it get "Py4JJavaError: An error occurred while calling o5082.csv." error.

Any idea how to solve it?

Thanks in advance!

jose_gonzalez · ‎04-25-2022

Hi @Laura Blancarte ,

What format is your "output" dataframe? Have you try to run something like this? output.coalesce(1).write.option("header","true").format("csv").save("path_to_location")

View solution in original post

jose_gonzalez · ‎05-10-2022

Hi @Laura Blancarte ,

Just a friendly follow-up. Do you still need help or you were able to find a solution to your question? if my previous response helped you to resolve your questions, please mark it as best.

laus · ‎05-10-2022

Only just seen this but your had used your solution in other scripts and it works!

get a "Py4JJavaError: An error occurred while calling o5082.csv." when trying to save to csv file.