https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30599#M22208 Thu, 30 Apr 2015 21:58:41 GMT cfregly 2015-04-30T21:58:41Z https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30599#M22208 Thu, 30 Apr 2015 21:58:41 GMT https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30599#M22208 cfregly 2015-04-30T21:58:41Z https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30600#M22209 <P></P><P>You can use the <PRE><CODE>DataFrame.na.fill()</CODE></PRE> method in Scala and the <PRE><CODE>DataFrame.fillna()</CODE></PRE> method in Python.</P><P>Here are the relevant links:</P><P>Scala:</P><P><A href="https://spark.apache.org/docs/1.3.1/api/scala/index.html#org.apache.spark.sql.DataFrame" target="_blank">https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrame</A></P><P><A href="https://spark.apache.org/docs/1.3.1/api/scala/index.html#org.apache.spark.sql.DataFrame" target="_blank"></A><A href="https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameNaFunctions" target="_blank">https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameNaFunctions</A></P><P>Python: </P><P><A href="http://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame.fillna" target="_blank">http://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame.fillna</A></P> Thu, 30 Apr 2015 22:00:10 GMT https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30600#M22209 cfregly 2015-04-30T22:00:10Z https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30601#M22210 <P></P> <P>How Do I check if the column is null ,column is integer type </P> <P></P> Wed, 18 May 2016 20:04:58 GMT https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30601#M22210 SiddarthaPaturu 2016-05-18T20:04:58Z https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30602#M22211 <P></P> <P>Spark version 2.1.0 returns following error:</P> <PRE><CODE> java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameNaFunctions.fill(JLscala/collection/Seq;)Lorg/apache/spark/sql/Dataset</CODE></PRE> <P></P> Wed, 10 May 2017 21:28:46 GMT https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30602#M22211 ManishTrivedi 2017-05-10T21:28:46Z https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30603#M22212 <P></P> <P>df.na.replace(df.columns,Map("" -&gt; "0")).show() // to convert from blank strings to zero</P> <P></P> Mon, 04 Sep 2017 12:21:27 GMT https://community.databricks.com/t5/data-engineering/how-do-i-replace-nulls-with-0-s-in-a-dataframe/m-p/30603#M22212 GauravKhare 2017-09-04T12:21:27Z