How do I replace nulls with 0's in a DataFrame?

[cfregly]

You can use the

DataFrame.na.fill()

method in Scala and the

DataFrame.fillna()

method in Python.

Here are the relevant links:

Scala:

https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrame

https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameNaFunctions

Python:

http://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame.fillna

[SiddarthaPaturu]

How Do I check if the column is null ,column is integer type

[ManishTrivedi]

Spark version 2.1.0 returns following error:

 java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameNaFunctions.fill(JLscala/collection/Seq;)Lorg/apache/spark/sql/Dataset

[GauravKhare]

df.na.replace(df.columns,Map("" -> "0")).show() // to convert from blank strings to zero