Mooune_DBU
Databricks Employee
Databricks Employee

With Koalas, which is a Pandas'API on top of Spark Dataframes, there should be minimal code changes required.

Please refer to this blog for more info