jash281098
New Contributor II

@Debayan One question - Will same approach work for JKS file containing private key certificate for X.509 authentication to Mongo Atlas database.

Usual way of adding below spark config's is not working. 

spark.driver.extraJavaOptions -Djavax.net.ssl.keyStore=/tmp/keystore.jks -Djavax.net.ssl.keyStorePassword=<pass>
spark.executor.extraJavaOptions -Djavax.net.ssl.keyStore=/tmp/keystore.jks -Djavax.net.ssl.keyStorePassword=<pass>

I have created following discussion - https://community.databricks.com/t5/data-engineering/issues-when-adding-keystore-spark-config-for-py...

Error in cluster logs - Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=mdb7sywh50xhpr.chkweekm4xjq.us-east-1.rds.amazonaws.com)(port=3306)(type=master) : readHandshakeRecord

25/05/10 14:19:06 WARN HiveClientImpl: HiveClient got thrift or connection reset exception, destroying client and retrying (13 tries remaining)

It is continuously showing above error and I can't execute any command on the cluster.