How to set ErroFile config for Spark driver and Spark executor JVM
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 03:27 PM
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 03:28 PM
spark.driver.extraJavaOptions -verbose:class -XX:ErrorFile=/dbfs/tmp/error_dir/java_error%p.log
spark.executor.extraJavaOptions -verbose:class -XX:ErrorFile=/dbfs/tmp/error_dir/java_error%p.log
kill -SIGSEGV <PID> for testing

