You can use the .drop() function, which is available as part of DataFrameNaFunctions.
With Scala:
https://spark.apache.org/docs/2.1.0/api/java/org/apache/spark/sql/DataFrameNaFunctions.html#drop()
With Python:
https://spark.apache.org/docs/latest/ap...
You can use the Databricks Libraries API to programmatically attach libraries to specific clusters. For more information: https://docs.databricks.com/api/latest/libraries.html#install
