cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Reading excel file using pandas on spark api not rendering #N/A values correctly

aa_204
New Contributor II

I am trying to read a .xlsx file using ps.read_excel() and having #N/A as a value for string type columns. But in the dataframe, i am getting "null" inplace of #N/A . Is there any option , using which we can read #N/A as a string in .xlsx file

 

4 REPLIES 4

daniel_sahal
Esteemed Contributor

aa_204
New Contributor II

Thanks @daniel_sahal  . I have tried 

na_Filter=False and na_values=['NA'],keep_default_na=False as well. But still not able to manipulate #N/A as string . . Each time it is getting converted to null or nan

vishwanath_1
New Contributor III

i am facing the same issue currently even after setting 

keep_default_na = False still #N/A is being converted as null
does anyone know the solution here?

Soumik
New Contributor II

Did you get a solution or workaround for this error, as I am also facing the same even after using dtype = str, na_filter= False, keep_default_na = False ?

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now