topic Re: NoClassDefFoundError: org/apache/spark/sql/SparkSession$ in Data Engineering

NoClassDefFoundError: org/apache/spark/sql/SparkSession$

bhanuteja_1 — Sat, 09 Nov 2024 05:22:45 GMT

NoClassDefFoundError: org/apache/spark/sql/SparkSession$
    at com.microsoft.nebula.common.ConfigProvider.<init>(configProvider.scala:17)
    at $linef37a348949c145718a08f6b29642317b35.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(command-1793822326551085:4)
   va:750)

It was 100 lines of error . I just posted glimpse of it . Please suggest me a solution for this error .

Re: NoClassDefFoundError: org/apache/spark/sql/SparkSession$

VZLA — Mon, 11 Nov 2024 12:16:06 GMT

Hi @bhanuteja_1 ,

Where are you running this from? Based on the short output, it looks like from a Databricks Notebook, but it would be a weird error unless you're having some classpath overrides or jar conflicts, leading to this error; it is simply saying the SparkSession class cannot be found in the classpath during runtime, although it is by default available in fresh clusters.