How to set ErroFile config for Spark driver and Spark executor JVM

brickster_2018
Databricks Employee
Databricks Employee

‎06-25-2021 03:27 PM

 
Labels:
0 Kudos

brickster_2018
Databricks Employee
Databricks Employee

‎06-25-2021 03:28 PM

spark.driver.extraJavaOptions -verbose:class -XX:ErrorFile=/dbfs/tmp/error_dir/java_error%p.log

spark.executor.extraJavaOptions -verbose:class -XX:ErrorFile=/dbfs/tmp/error_dir/java_error%p.log

kill -SIGSEGV <PID> for testing

0 Kudos