Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 12:13 PM
How to identify the jars used to load a particular class. I am sure I packed the classes correctly in my application jar. However, looks like the class is loaded from a different jar. I want to understand the details so that I can ensure to use the right version of the jar and avoid conflict.
Labels:
- Labels:
-
Data Ingestion & connectivity
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 12:14 PM
Adding the below configurations at the cluster level can help to print more logs to identify the jars from which the class is loaded.
- spark.executor.extraJavaOptions=-verbose:class
- spark.driver.extraJavaOptions=-verbose:class