VZLA
Databricks Employee
Databricks Employee

You can add to both the driver and executors extraJavaOptions the -verbose:class option, and then check the Spark Logs, example:

  • spark.driver.extraJavaOptions -verbose:class
  • spark.executor.extraJavaOptions -verbose:class

Same with regard to the jar distribution and localization, this will be visible in the Spark Logs.