Upgrade Spark version 3.2 to 3.4+

Phani1
Databricks MVP

Hi Team,

We would like to upgrade from Spark version 3.2 to 3.4+ (Databricks Runtime - 10.4 to 12.2/13.3)

We would like to understand how complex upgradation is this and challenges which we face? what are the technical steps and precautions we need to take care?

 

 

Hi Team, could you please share technical steps which need to follow step by step and complete the upgradation.

and how we come to know what all the objects are will be impacted.