Ismael-K
Databricks Employee
Databricks Employee

@sahil_s_jain Please try setting this spark property on the 15.4 cluster:

 

sparkConf.set("spark.sql.legacy.jdbc.useNullCalendar", "false")

 

After the property is set, Spark will not use a Null calendar instance for JDBC operations.

You can also add the below property to set the spark session timezone:

 

spark.conf.set("spark.sql.session.timeZone", "America/New_York")

 

 

 

View solution in original post