get a "Py4JJavaError: An error occurred while calling o5082.csv." when trying to save to csv file.

[laus]

Hi,

I'm trying to save a dataframe to csv with the code below:

output.coalesce(1).write.mode('overwrite').option('header', 'true').csv(tmp_file_path) 

But it get "Py4JJavaError: An error occurred while calling o5082.csv." error.

Any idea how to solve it?

 

Thanks in advance!

[Kaniz]

Hi @Laura Blancarte​ , Looks like you want to save your dataframe as CSV. Did you try to download the preview?

[jose_gonzalez · Accepted solution]

Hi @Laura Blancarte​ ,

What format is your "output" dataframe? Have you try to run something like this? output.coalesce(1).write.option("header","true").format("csv").save("path_to_location")

[jose_gonzalez]

Hi @Laura Blancarte​ ,

Just a friendly follow-up. Do you still need help or you were able to find a solution to your question? if my previous response helped you to resolve your questions, please mark it as best.

[laus]

Only just seen this but your had used your solution in other scripts and it works!

[Kaniz]

Awesome @Laura Blancarte​ . Thank you for the update.