-werners-
Esteemed Contributor III

the error is pretty clear:

user submitted code makes the spark driver fail (scaladriverlocal).

The error explains that 'beam' does not exist. You use Apache Beam Sparkrunner in your submitted code but it seems the package is not installed on the cluster (or not imported).

https://beam.apache.org/documentation/runners/spark/