Databricks <-> Kafka - SSL handshake failed
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-17-2022 09:36 AM
I am receiving SSL handshake error even though the trust-store I have created is based on server certificate and the fingerprint in the certificate matches the trust-store fingerprint.
kafkashaded.org.apache.kafka.common.errors.SslAuthenticationException: SSL handshake failed Caused by: sun.security.validator.ValidatorException: PKIX path validation failed: java.security.cert.CertPathValidatorException: signature check failed Caused by: java.security.cert.CertPathValidatorException: signature check failed Caused by: java.security.SignatureException: Signature does not match.
df = spark.readStream \
.format("kafka") \
.option("kafka.bootstrap.servers","XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX") \
.option("kafka.security.protocol", "SSL") \
.option("kafka.ssl.truststore.location",'/dbfs/dbfs/FileStore/Certs/client.truststore1der.jks' )
.option("kafka.ssl.keystore.location", '/dbfs/dbfs/FileStore/Certs/client.keystore.jks') \
.option("kafka.ssl.keystore.password", keystore_pass) \
.option("kafka.ssl.truststore.password", truststore_pass) \
.option("kafka.ssl.keystore.type", "JKS") \
.option("kafka.ssl.truststore.type", "JKS") \
.option("kafka.ssl.endpoint.identification.algorithm","") \
.option("subscribe","bets") \
.load()
- Labels:
-
Kafka
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-17-2022 11:18 PM
Hi @Jayanth Goulla , worth a try ,
https://stackoverflow.com/questions/54903381/kafka-failed-authentication-due-to-ssl-handshake-failed
Did you follow: https://docs.microsoft.com/en-us/azure/databricks/spark/latest/structured-streaming/kafka?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-18-2022 01:09 AM
Hi @Debayan Mukherjee , I have already specified the option .option("kafka.ssl.endpoint.identification.algorithm","") \.
My error is specific to signature not matching
java.security.SignatureException: Signature does not match.
The 2nd link is not working