https://community.databricks.com/t5/data-engineering/classpath-issues-when-running-spark-submit/m-p/18922#M12615 <P>How to identify the jars used to load a particular class. I am sure I packed the classes correctly in my application jar. However, looks like the class is loaded from a different jar. I want to understand the details so that I can ensure to use the right version of the jar and avoid conflict. </P> Fri, 25 Jun 2021 19:13:22 GMT brickster_2018 2021-06-25T19:13:22Z https://community.databricks.com/t5/data-engineering/classpath-issues-when-running-spark-submit/m-p/18922#M12615 <P>How to identify the jars used to load a particular class. I am sure I packed the classes correctly in my application jar. However, looks like the class is loaded from a different jar. I want to understand the details so that I can ensure to use the right version of the jar and avoid conflict. </P> Fri, 25 Jun 2021 19:13:22 GMT https://community.databricks.com/t5/data-engineering/classpath-issues-when-running-spark-submit/m-p/18922#M12615 brickster_2018 2021-06-25T19:13:22Z https://community.databricks.com/t5/data-engineering/classpath-issues-when-running-spark-submit/m-p/18923#M12616 <P>Adding the below configurations at the cluster level can help to print more logs to identify the jars from which the class is loaded. </P><P></P><UL><LI>spark.executor.extraJavaOptions=-verbose:class </LI><LI>spark.driver.extraJavaOptions=-verbose:class</LI></UL><P></P> Fri, 25 Jun 2021 19:14:49 GMT https://community.databricks.com/t5/data-engineering/classpath-issues-when-running-spark-submit/m-p/18923#M12616 brickster_2018 2021-06-25T19:14:49Z