topic Re: getting "NoSuchMethodError" while using tsl 15.4 and spark 3.5 in Data Engineering

getting "NoSuchMethodError" while using tsl 15.4 and spark 3.5

developer321 — Sun, 02 Feb 2025 22:09:51 GMT

hi, i am using data bricks version 15.4 and spark 3.5 and getting "NoSuchMethodError" and all the resources i found only solution is to downgrade spark and data bricks version. is there any solution apart from this as i cant do this in my case.
regards

Re: getting "NoSuchMethodError" while using tsl 15.4 and spark 3.5

Alberto_Umana — Sun, 02 Feb 2025 22:13:09 GMT

Hi @developer321,

Are you upgrading any of the default libraries of DBR 15.4 LTS? please share more details on your use-case and commands / settings being used.

Re: getting "NoSuchMethodError" while using tsl 15.4 and spark 3.5

developer321 — Sun, 02 Feb 2025 22:21:51 GMT

hi, no I didn't update any library everything is default.

below is the code I am connecting with the azure SQL database.

server_name = "jdbc:sqlserver://{SERVER_ADDR}"
database_name = "database_name"
url = server_name + ";" + "databaseName=" + database_name + ";"

table_name = "table_name"
username = "username"
password = "password123!#" # Please specify password here

try:
df.write \
.format("com.microsoft.sqlserver.jdbc.spark") \
.mode("overwrite") \
.option("url", url) \
.option("dbtable", table_name) \
.option("user", username) \
.option("password", password) \
.save()
except ValueError as error :
print("Connector write failed", error)

and i am using this driver for connecting with my database spark 3.4 beta connector