Databricks

MC006 · 12-19-2022

Hi, I am using Databricks and want to upgrade to Databricks runtime version 11.3 LTS which uses Spark 3.3 now. Current system enviroment:Operating System: Ubuntu 20.04.4 LTSJava: Zulu 8.56.0.21-CA-linux64Python: 3.8.10Delta Lake: 1.1.0Target system ...

MC006 · 12-21-2022

Hi @Debayan Mukherjee I think i found RC.My Spark config for the java libraries doesn't upgrade in the pipeline due to some reasons. After Upgrade java libraries , the error was gone. Anyway, thanks.

MC006 · 12-20-2022

Hi @Debayan Mukherjee ,there is the whole output>>> spark = get_spark() :: loading settings :: url = jar:file:/usr/local/lib/python3.8/dist-packages/pyspark/jars/ivy-2.5.0.jar!/org/apache/ivy/core/settings/ivysettings.xml Ivy Default Cache set to: /...

Databricks

User Stats

User Activity

java.lang.NoSuchMethodError after upgrade to Databricks Runtime 11.3 LTS

Re: java.lang.NoSuchMethodError after upgrade to Databricks Runtime 11.3 LTS

Re: java.lang.NoSuchMethodError after upgrade to Databricks Runtime 11.3 LTS