Databricks Community

vasu_sethia · 10-28-2021

Hi I have a DF which contains Json string so the value is like {"key": Value, "anotherKey": anotherValue}, so when I am trying to write the DF containing this string to the CSV, spark is adding NUL character af the front of this line and at the end,...

vasu_sethia · 10-29-2021

Thank you so much, this worked for me

vasu_sethia · 10-29-2021

df.coalesce(1).write.format("csv").option("header", false).option("quote", "").save(path)This is the code and yes I do have comma in the string

vasu_sethia · 10-29-2021

I have a value in my dataframe column in the format of Json string, I am trying to write the dataframe to the csv_________Value__________{"Name": ABC, "age": 12}__________

Databricks Community

User Stats

User Activity

Spark adding NUL

Re: Spark adding NUL

Re: Spark adding NUL

Re: Spark adding NUL