topic Re: Databricks notebook issue in Get Started Discussions

Databricks notebook issue

Hani4hanuman — Sat, 05 Aug 2023 14:40:16 GMT

Hi,

I'm trying to run ADF pipeline.However, it is getting fail at Notebook activity with below error.

Error :NoSuchMethodError: com.microsoft.sqlserver.jdbc.SQLServerBulkCopy.writeToServer(Lcom/microsoft/sqlserver/jdbc/ISQLServerBulkRecord;)V

I think it's related to libraries issue but not sure which one need to install to resolve the issue.

Details: My Azure Databricks cluster runtime is 9.1LTS and scala 2.12 version.

Can you please help on this . I tried with installing with different libraries like below but not worked..

com.microsoft.azure:spark-mssql-connector_2.12:1.2.0

Re: Databricks notebook issue

shan_chandra — Sun, 06 Aug 2023 22:01:44 GMT

@Hani4hanuman - Kindly try with the latest connector - com.microsoft.azure:spark-mssql-connector_2.12:1.3.0 and use the latest DBR 12.2 LTS and above.

If the issue still persists, kindly raise a support case with us.

Re: Databricks notebook issue

Hani4hanuman — Mon, 07 Aug 2023 04:07:44 GMT

@shan_chandra Thanks for your reply as per your suggetion changed Databricks version from 9.1LTS to 12.2LTS

But after change this when i check library which you provided(i.e com.microsoft.azure:spark-mssql-connector_2.12:1.3.0) under Maven it is not available in the list,. only Beta version available even i used that also but its failing