cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 

Requirement to Run Koalas

User16826994223
Honored Contributor III

‎06-22-2021 11:18 PM

Hi I am planning to run Koalas on Databricks environment, What are the requirements for running Koalas there

Labels:
0 Kudos
2 REPLIES 2

User16826994223
Honored Contributor III

‎06-22-2021 11:19 PM

  • Koalas is included on clusters running Databricks Runtime 7.3 and above.
  • To use Koalas on a cluster running Databricks Runtime 7.0 or below, install Koalas as an Azure Databricks PyPI library.
  • To use Koalas in an IDE, notebook server, or other custom applications that connect to an Azure Databricks cluster, install Databricks Connect and follow the Koalas installation instructions.

0 Kudos

tj-cycyota
Databricks Employee
Databricks Employee

‎06-23-2021 08:05 AM

Koalas is great! This really helps ease the transition from Pandas to Spark, because you can just use the same Pandas functions/classes through the Koalas API but everything runs in the background in Spark.

0 Kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Announcements
Top