https://community.databricks.com/t5/data-engineering/converting-between-pandas-to-koalas/m-p/26602#M18628 Koalas is distributed on a Databricks cluster similar to how Spark dataframes are also distributed. Pandas dataframes only live on the spark driver in memory. If you are a pandas user and are using a multi-node cluster then you should use koalas to process the data. If you are able to use a single node databricks cluster then pandas could fit your needs as the data likely fits on a single computer. Fri, 04 Jun 2021 11:31:00 GMT Ryan_Chynoweth 2021-06-04T11:31:00Z https://community.databricks.com/t5/data-engineering/converting-between-pandas-to-koalas/m-p/26601#M18627 <P>When and why should I convert b/w a Pandas to Koalas dataframe? What are the implications?</P><P></P> Wed, 02 Jun 2021 23:34:38 GMT https://community.databricks.com/t5/data-engineering/converting-between-pandas-to-koalas/m-p/26601#M18627 Anonymous 2021-06-02T23:34:38Z https://community.databricks.com/t5/data-engineering/converting-between-pandas-to-koalas/m-p/26602#M18628 Koalas is distributed on a Databricks cluster similar to how Spark dataframes are also distributed. Pandas dataframes only live on the spark driver in memory. If you are a pandas user and are using a multi-node cluster then you should use koalas to process the data. If you are able to use a single node databricks cluster then pandas could fit your needs as the data likely fits on a single computer. Fri, 04 Jun 2021 11:31:00 GMT https://community.databricks.com/t5/data-engineering/converting-between-pandas-to-koalas/m-p/26602#M18628 Ryan_Chynoweth 2021-06-04T11:31:00Z