https://community.databricks.com/t5/data-engineering/when-should-i-use-pandas-pyspark-and-koalas/m-p/25308#M17581 <P>Pandas works for single machine computations, so any pandas code you write on Databricks will run on the driver of the cluster. Pyspark and Koalas are both distributed frameworks for when you have large datasets. You can use Pyspark and Koalas interchangeably depending on if you prefer the Spark or the Pandas style syntax </P> Thu, 10 Jun 2021 17:59:14 GMT User16752246141 2021-06-10T17:59:14Z https://community.databricks.com/t5/data-engineering/when-should-i-use-pandas-pyspark-and-koalas/m-p/25307#M17580 Thu, 10 Jun 2021 17:57:03 GMT https://community.databricks.com/t5/data-engineering/when-should-i-use-pandas-pyspark-and-koalas/m-p/25307#M17580 j_weaver 2021-06-10T17:57:03Z https://community.databricks.com/t5/data-engineering/when-should-i-use-pandas-pyspark-and-koalas/m-p/25308#M17581 <P>Pandas works for single machine computations, so any pandas code you write on Databricks will run on the driver of the cluster. Pyspark and Koalas are both distributed frameworks for when you have large datasets. You can use Pyspark and Koalas interchangeably depending on if you prefer the Spark or the Pandas style syntax </P> Thu, 10 Jun 2021 17:59:14 GMT https://community.databricks.com/t5/data-engineering/when-should-i-use-pandas-pyspark-and-koalas/m-p/25308#M17581 User16752246141 2021-06-10T17:59:14Z