cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
DELETE
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to set ErroFile config for Spark driver and Spark executor JVM

User16869510359
Esteemed Contributor
 
1 REPLY 1

User16869510359
Esteemed Contributor

spark.driver.extraJavaOptions -verbose:class -XX:ErrorFile=/dbfs/tmp/error_dir/java_error%p.log

spark.executor.extraJavaOptions -verbose:class -XX:ErrorFile=/dbfs/tmp/error_dir/java_error%p.log

kill -SIGSEGV <PID> for testing

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.