cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Error when writing dataframe to s3 location using PySpark

Constantine
Contributor III

I get an error when writing dataframe to s3 location

Found invalid character(s) among " ,;{}()\n\t=" in the column names of your

I have gone through all the columns and none of them have any special characters. Any idea how to fix this?

2 REPLIES 2

Emilie
New Contributor II

I got this error when I was running a query given to me, and the author didn't have aliases on aggregates. Something like:

sum(dollars_spent)

needed an alias:

sum(dollars_spent) as sum_dollars_spent

Hi @John Constantine​,

Just a friendly follow-up. Do you still need help or you were able to find the solution to this issue? please let us know.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group