cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Change in spark code if I migrate from spark 2.4 to 3.0

Go to solution
User16826994223
Honored Contributor III

‎06-25-2021 10:21 PM

I am thinking of migrating the spark 2.4 to 3.0, what should I know to take care of changes thet I need to look at while migrating

Labels:
0 Kudos
1 ACCEPTED SOLUTION

Accepted Solutions

Go to solution
User16826994223
Honored Contributor III

‎06-25-2021 10:25 PM

I see there are many changes that need to take care of if you have used coding in spark 2.4

the changes are in Data set API Statement

Builtin UDF and functions

More you can get from spark Documentation

https://spark.apache.org/docs/latest/sql-migration-guide.html#upgrading-from-spark-sql-24-to-30

View solution in original post

0 Kudos
1 REPLY 1

Go to solution
User16826994223
Honored Contributor III

‎06-25-2021 10:25 PM

I see there are many changes that need to take care of if you have used coding in spark 2.4

the changes are in Data set API Statement

Builtin UDF and functions

More you can get from spark Documentation

https://spark.apache.org/docs/latest/sql-migration-guide.html#upgrading-from-spark-sql-24-to-30

0 Kudos
Announcements
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.