<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Random NoClassDefFound Error when running job in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/random-noclassdeffound-error-when-running-job/m-p/71407#M34308</link>
    <description>&lt;P&gt;We are running a job on a cluster with DBR 10.4 LTS Spark 3.2.1 and scala 2.12. Cluster is using 4 workers (spot instances) .The driver is not a spot instance&lt;/P&gt;&lt;P&gt;Randomly ( only on one environment and not all executions), we are getting the following error : &lt;EM&gt;java.lang.NoClassDefFoundError: Could not initialize class path.to.one.of.our.Class$&lt;/EM&gt;&lt;/P&gt;&lt;P&gt;The class does exists and is present in the jar we are loading as a dependant library in the job task definition. The jar was compiled with the same versions (3.2.1/2.12)&lt;/P&gt;&lt;P&gt;The environment is identical to other working ones and as I 've mentionned, just relaunching the same failing job&amp;nbsp; once makes it succeed, without changing anything.&lt;/P&gt;&lt;P&gt;Any ideas regarding what could the problem possibly be ?&lt;/P&gt;</description>
    <pubDate>Mon, 03 Jun 2024 07:13:20 GMT</pubDate>
    <dc:creator>abaet</dc:creator>
    <dc:date>2024-06-03T07:13:20Z</dc:date>
    <item>
      <title>Random NoClassDefFound Error when running job</title>
      <link>https://community.databricks.com/t5/data-engineering/random-noclassdeffound-error-when-running-job/m-p/71407#M34308</link>
      <description>&lt;P&gt;We are running a job on a cluster with DBR 10.4 LTS Spark 3.2.1 and scala 2.12. Cluster is using 4 workers (spot instances) .The driver is not a spot instance&lt;/P&gt;&lt;P&gt;Randomly ( only on one environment and not all executions), we are getting the following error : &lt;EM&gt;java.lang.NoClassDefFoundError: Could not initialize class path.to.one.of.our.Class$&lt;/EM&gt;&lt;/P&gt;&lt;P&gt;The class does exists and is present in the jar we are loading as a dependant library in the job task definition. The jar was compiled with the same versions (3.2.1/2.12)&lt;/P&gt;&lt;P&gt;The environment is identical to other working ones and as I 've mentionned, just relaunching the same failing job&amp;nbsp; once makes it succeed, without changing anything.&lt;/P&gt;&lt;P&gt;Any ideas regarding what could the problem possibly be ?&lt;/P&gt;</description>
      <pubDate>Mon, 03 Jun 2024 07:13:20 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/random-noclassdeffound-error-when-running-job/m-p/71407#M34308</guid>
      <dc:creator>abaet</dc:creator>
      <dc:date>2024-06-03T07:13:20Z</dc:date>
    </item>
  </channel>
</rss>

