topic Re: SparkJDBC42.jar Issue ? in Data Engineering

SparkJDBC42.jar Issue ?

SCOR — Tue, 08 Feb 2022 09:11:50 GMT

Hi there!

I am using the SparkJDBC42.jar in my Java application to use my delta lake tables , The connection is made through databricks sql endpoint in where I created a database and store in it my delta tables. I have a simple code to open connection between the application and the sql endpoint : I used a driver manager to get The connection Object to use the prepared statement, The connection is well opened but it will be closed after some time, I have a method to refresh connection by opening a new one when it is not valid anymore, for that I use the method (isValid(int timeout)) from javax.sql.Connection and I think it uses the Hive42Connection ( from the SparkJDBC42.jar) implementation for that, this method is returning true in some environment even if the connection is closed from databricks side. Is this an issue with the driver or am I not using it the best way ?

Thank you. 🙂

Re: SparkJDBC42.jar Issue ?

Anonymous — Wed, 09 Feb 2022 16:30:57 GMT

Hi there, @Seifeddine SNOUSSI

My name is Piper, and I'm a community moderator for Databricks. Welcome to the community and thank you for bringing us your question. 🙂

Let's give it a bit longer for your peers to respond. We'll circle back to you if we need to.

Re: SparkJDBC42.jar Issue ?

Atanu — Thu, 17 Feb 2022 14:00:52 GMT

@Seifeddine SNOUSSI could you please share a link which you followed to install the same?

Re: SparkJDBC42.jar Issue ?

jose_gonzalez — Mon, 07 Mar 2022 23:10:08 GMT

Hi @Seifeddine SNOUSSI ,

Are you still having issue or you were able to resolve this issue? please let us know