cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Pandas 2.x availability

turagittech
New Contributor

Hi All,

I am wondering if Pandas 2.x will be available soon or is it an available option to install.

I have a small job I built to manipulate some strings from  a database table when technically did the job, but doesn't scale with older versions of pandas.Several million rows are in the dataframe.

I hadn't touched it for a while and came back to it thinking Pandas 2.x would be available, but looking at release notes it only shows 1.5.3

 

Thanks for any help

Peter

1 REPLY 1

Kaniz
Community Manager
Community Manager

Hi @turagittechThe latest version of pandas mentioned is 1.5.3.

Suppose you are looking to improve the scalability of your panda operations. In that case, you might consider using Koalas, which provides a pandas-like API on top of PySpark DataFrames, allowing for more scalable processes.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.