topic AWS Databricks Pyspark - Unable to connect to Azure MySQL - Shows "SSL Connection is required" in Data Engineering

AWS Databricks Pyspark - Unable to connect to Azure MySQL - Shows "SSL Connection is required"

Rexton — Thu, 26 May 2022 14:22:11 GMT

Even after specifying SSL options, unable to connect to MySQL. What could have gone wrong? Could anyone experience similar issues?

df_target_master = spark.read.format("jdbc")\

.option("driver", "com.mysql.jdbc.Driver")\

.option("url", host_url)\

.option("dbtable", supply_master)\

.option("user", user_id)\

.option("password", pwd)\

.option("ssl", True) \

.option("sslmode", "verify-ca" ) \

.option("sslrootcert", "<s3 bucket location") \

.load()

Re: AWS Databricks Pyspark - Unable to connect to Azure MySQL - Shows "SSL Connection is required"

User16764241763 — Mon, 06 Jun 2022 03:39:40 GMT

@Rexton Das

Can you try disabling below SSL setting on MySQL Azure Database -> Connection Security and see if it connects?

Re: AWS Databricks Pyspark - Unable to connect to Azure MySQL - Shows "SSL Connection is required"

User16764241763 — Mon, 06 Jun 2022 03:42:08 GMT

Or you can try enabling SSL in the URL using &useSSL=true&requireSSL=true

Re: AWS Databricks Pyspark - Unable to connect to Azure MySQL - Shows "SSL Connection is required"

a2barbosa — Thu, 13 Apr 2023 14:34:56 GMT

Hey,

Here the solution: The correct option for ssl is "useSSL" and not just "ssl".

This code below could works:

df_target_master = spark.read.format("jdbc")\

.option("driver", "com.mysql.jdbc.Driver")\

.option("url", host_url)\

.option("dbtable", supply_master)\

.option("user", user_id)\

.option("password", pwd)\

.option("useSSL", True) \

.option("sslmode", "verify-ca" ) \

.option("sslrootcert", "<s3 bucket location") \

.load()

I'm able to access a mySQL with "Enforce SSL Connection" Enabled in Azure with only this change.

In Databricks Runtime 11.2 and above you can use the MySQL connector in Databricks Runtime. The code could be like this:

remote_table = (spark.read

.format("mysql")

.option("dbtable", table)

.option("host", database_host_url)

.option("port", 3306)

.option("database", database_name)

.option("user", uid)

.option("password", pwd)

.option("useSSL", True)

.option("sslmode", "verify-ca" )

.load()

)