org.apache.spark.SparkException: Job aborted due to stage failure:

[karola61]

org.apache.spark.SparkException: Job aborted due to stage failure:

[Kaniz_Fatma · Accepted solution]

Hi @karola61, 

• The error message indicates a ClassNotFoundException for the class maven.maven1.Document. This means that Spark cannot find the specified class.
• Make sure that the class maven.maven1.Document is available in your application’s classpath. If it’s part of a Maven or SBT dependency, ensure that the dependency is correctly added.
• Verify that the class name and package are correctly specified in your code.

[rajeshg]

Along with Job aborted due to stage failure: if you see slave lost... then it is due to less memory allocated for executors, more cores per executor more memory required or the other possibility is you have used max cpu available in cluster and the demand is more