Re: Databricks notebook issue

Hani4hanuman · ‎08-05-2023

Hi,

I'm trying to run ADF pipeline.However, it is getting fail at Notebook activity with below error.

Error :NoSuchMethodError: com.microsoft.sqlserver.jdbc.SQLServerBulkCopy.writeToServer(Lcom/microsoft/sqlserver/jdbc/ISQLServerBulkRecord;)V

I think it's related to libraries issue but not sure which one need to install to resolve the issue.

Details: My Azure Databricks cluster runtime is 9.1LTS and scala 2.12 version.

Can you please help on this . I tried with installing with different libraries like below but not worked..

com.microsoft.azure:spark-mssql-connector_2.12:1.2.0

shan_chandra · ‎08-06-2023

@Hani4hanuman - Kindly try with the latest connector - com.microsoft.azure:spark-mssql-connector_2.12:1.3.0 and use the latest DBR 12.2 LTS and above.

If the issue still persists, kindly raise a support case with us.

Hani4hanuman · ‎08-06-2023

@shan_chandra Thanks for your reply as per your suggetion changed Databricks version from 9.1LTS to 12.2LTS

But after change this when i check library which you provided(i.e com.microsoft.azure:spark-mssql-connector_2.12:1.3.0) under Maven it is not available in the list,. only Beta version available even i used that also but its failing