topic Re: what is the supported mssql connector for Databricks runtime 11.3LTS Scala 2.12 Spark 3.3.0? in Data Engineering

what is the supported mssql connector for Databricks runtime 11.3LTS Scala 2.12 Spark 3.3.0?

Databricks_-Dat — Thu, 09 Feb 2023 10:11:34 GMT

We were using mssql connector -com.microsoft.azure:spark-mssql-connector_2.12_3.0:1.0.0-alpha with 10.3LTS DBR. As we need to upgrade to higher version of DBR to make use of new functions like unpivot/melt in the notebooks.

-com.microsoft.azure:spark-mssql-connector_2.12_3.0:1.0.0-alpha connector is not supported in DBR 11.4 LTS? any one know supported mssql connector version , will be a great help. Thanks.

Re: what is the supported mssql connector for Databricks runtime 11.3LTS Scala 2.12 Spark 3.3.0?

Manoj12421 — Thu, 09 Feb 2023 19:16:58 GMT

Spark 3.1.x compatible connector

Re: what is the supported mssql connector for Databricks runtime 11.3LTS Scala 2.12 Spark 3.3.0?

ranged_coop — Fri, 10 Feb 2023 11:45:52 GMT

Is the spark 3.3 series even supported by the connector yet ?

As per the [github link](https://github.com/microsoft/sql-spark-connector#current-releases) - assuming this is the library you are trying to use ?

The latest Spark 2.4.x compatible connector is on v1.0.2.

The latest Spark 3.0.x compatible connector is on v1.1.0.

The latest Spark 3.1.x compatible connector is on v1.2.0.

Kindly check once in the documentation.