brickster_2018
Databricks Employee
Databricks Employee

Adding the below configurations at the cluster level can help to print more logs to identify the jars from which the class is loaded.

  • spark.executor.extraJavaOptions=-verbose:class
  • spark.driver.extraJavaOptions=-verbose:class

View solution in original post