topic Re: Error while writing dataframe to csv file. in Get Started Discussions

Error while writing dataframe to csv file.

Shriyash — Sat, 29 Jun 2024 21:30:43 GMT

Hi Folks,
Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.

Error:
py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.
: java.lang.UnsatisfiedLinkError: 'boolean

Code Snippet:

mode_write = "overwrite"
header_write = "true"
path = "F://SampleData_Databricks/Certificate_Output/"
certified_df.write \
    .option("mode", mode_write) \
    .option("header", header) \
    .option("path", path) \
    .save()

Can someone help me to resolve this issue?

Re: Error while writing dataframe to csv file.

Witold — Mon, 01 Jul 2024 08:27:22 GMT

@Shriyash wrote:
Hi Folks,
Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.

Error:
py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.
: java.lang.UnsatisfiedLinkError: 'boolean
Code Snippet:
mode_write = "overwrite"
header_write = "true"
path = "F://SampleData_Databricks/Certificate_Output/"
certified_df.write \
    .option("mode", mode_write) \
    .option("header", header) \
    .option("path", path) \
    .save()
path = "F://SampleData_Databricks/Certificate_Output/"

You're working in a cloud environment. You can't write to your local storage from there. Try to write to your corresponding cloud storage instead.

Re: Error while writing dataframe to csv file.

Shriyash — Mon, 01 Jul 2024 18:08:30 GMT

Hi Witold, When you say cloud environment are you refering to databricks?🤔
The Path, where I'm trying to store the data, might be misleading as folder name have Databricks naming in it. But I'm working in my local setup, From Databricks I'm able to write the file in DBFS.
When It comes to local setup It is causing trouble.

Screenshot for reference.

Let me know, If I'm missing something.

Thanks,
Shriyash

Re: Error while writing dataframe to csv file.

Witold — Mon, 01 Jul 2024 19:59:46 GMT

Do I see it correctly that you're actually not using Databricks, but Spark, locally installed, instead? Your issue can have many different causes, like an incompatible Java version. In this case, I can only refer to the official docs.