09-20-2018 08:58 AM
You can use the .drop() function, which is available as part of DataFrameNaFunctions.
With Scala:
https://spark.apache.org/docs/2.1.0/api/java/org/apache/spark/sql/DataFrameNaFunctions.html#drop()
With Python:
https://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=nafunctions#pyspark.sql.D...
