What does "ScalaDriverLocal: User Code Compile error" mean?

cozos
New Contributor III

‎11-30-2022 09:06 PM 

22/11/30 01:45:31 WARN ScalaDriverLocal: loadLibraries: Libraries failed to be installed: Set()
 
22/11/30 01:50:14 INFO Utils: resolved command to be run: WrappedArray(getconf, PAGESIZE)
22/11/30 01:50:15 WARN ScalaDriverLocal: User Code Compile error: command--1:1: error: object beam is not a member of package org.apache
org.apache.beam.runners.spark.SparkPipelineRunner.main(Array())

I have submitted a Jar job and my error looks like that. What does it mean to get a "User Code Compile error"?

I am curious:

  • What is ScalaDriverLocal: User Code Compile doing?
  • What is causing ScalaDriverLocal: User Code Compile to fail?
  • What does it mean for ScalaDriverLocal: User Code Compile to fail? How can the pipeline continue to run after something like that?

Labels: