How to incorporate these GC options into my Databricks Cluster? )(spark.executor.extraJavaOptions)

auser85
New Contributor III

‎12-16-2022 07:49 AM

I want to try incorporating these options into my databricks cluster.

spark.driver.extraJavaOptions -XX:+UseG1GC -XX:+G1SummarizeConcMark
spark.executor.extraJavaOptions -XX:+UseG1GC -XX:+G1SummarizeConcMark

If I put them under Compute -> Cluster -> Configuration -> Advanced Options -> Spark -> Spark config, my cluster fails to boot;

If I add them to Compute -> Cluster -> Configuration -> Advanced Options -> Spark -> Environment variables, the UI says its an illegal key value pair and wont proceed.

0 Kudos