03-31-2022 09:35 AM
Hi,
I'm trying to save a dataframe to csv with the code below:
output.coalesce(1).write.mode('overwrite').option('header', 'true').csv(tmp_file_path)
But it get "Py4JJavaError: An error occurred while calling o5082.csv." error.
Any idea how to solve it?
Thanks in advance!
04-25-2022 03:17 PM
Hi @Laura Blancarte ,
What format is your "output" dataframe? Have you try to run something like this? output.coalesce(1).write.option("header","true").format("csv").save("path_to_location")
04-04-2022 02:52 AM
Hi @Laura Blancarte , Looks like you want to save your dataframe as CSV. Did you try to download the preview?
04-25-2022 03:17 PM
Hi @Laura Blancarte ,
What format is your "output" dataframe? Have you try to run something like this? output.coalesce(1).write.option("header","true").format("csv").save("path_to_location")
05-10-2022 10:27 AM
Hi @Laura Blancarte ,
Just a friendly follow-up. Do you still need help or you were able to find a solution to your question? if my previous response helped you to resolve your questions, please mark it as best.
05-10-2022 11:24 AM
Only just seen this but your had used your solution in other scripts and it works!
05-10-2022 11:43 PM
Awesome @Laura Blancarte . Thank you for the update.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.