https://community.databricks.com/t5/data-engineering/which-mllib-library-am-i-supposed-to-use-pyspark-mllib-or/m-p/24282#M16873 <P>Both of these libraries seem to be available and they are both for MLlib, how do I know which one to use?</P> Tue, 15 Jun 2021 21:01:23 GMT User16826992666 2021-06-15T21:01:23Z https://community.databricks.com/t5/data-engineering/which-mllib-library-am-i-supposed-to-use-pyspark-mllib-or/m-p/24282#M16873 <P>Both of these libraries seem to be available and they are both for MLlib, how do I know which one to use?</P> Tue, 15 Jun 2021 21:01:23 GMT https://community.databricks.com/t5/data-engineering/which-mllib-library-am-i-supposed-to-use-pyspark-mllib-or/m-p/24282#M16873 User16826992666 2021-06-15T21:01:23Z https://community.databricks.com/t5/data-engineering/which-mllib-library-am-i-supposed-to-use-pyspark-mllib-or/m-p/24283#M16874 <P>The pyspark.mllib library is built for RDD's, and the pyspark.ml library is built for Dataframes. The RDD-based mllib library is currently in maintenance mode, while the Dataframe library will continue to receive updates and active development. For that reason, plus the fact that Dataframes are more common and are generally recommended to use, you will usually want to use the pyspark.ml library. </P> Tue, 15 Jun 2021 21:04:46 GMT https://community.databricks.com/t5/data-engineering/which-mllib-library-am-i-supposed-to-use-pyspark-mllib-or/m-p/24283#M16874 User16826992666 2021-06-15T21:04:46Z