cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Reading excel file using pandas on spark api not rendering #N/A values correctly

aa_204
New Contributor II

I am trying to read a .xlsx file using ps.read_excel() and having #N/A as a value for string type columns. But in the dataframe, i am getting "null" inplace of #N/A . Is there any option , using which we can read #N/A as a string in .xlsx file

 

3 REPLIES 3

daniel_sahal
Esteemed Contributor

aa_204
New Contributor II

Thanks @daniel_sahal  . I have tried 

na_Filter=False and na_values=['NA'],keep_default_na=False as well. But still not able to manipulate #N/A as string . . Each time it is getting converted to null or nan

vishwanath_1
New Contributor III

i am facing the same issue currently even after setting 

keep_default_na = False still #N/A is being converted as null
does anyone know the solution here?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group