JDBC Connection Issues - Databricks Idle Cluster Mode
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Monday
Hello everyone, We are having a problem with the data fetch process from our Databricks compute database through a JDBC connection.
**Issue Description:**
We are utilizing a Java 17 application, hosted on Azure Cloud, to fetch data from our Databricks compute database. The connection is established using the below JDBC URL:
jdbc:databricks://adb-123456789.1.azuredatabricks.net:443/default;transportMode=HTTP;httpPath=sql/protocolv1/o/123456789/1234-123456-123abcde;EnableArrow=0;ssl=1;AuthMech=3;
Please let me know if you need any further information regarding this issue.
The data retrieval succeeds when the Databricks cluster is active. But when the cluster is inactive (terminated), rather than creating a connection and spining up the cluster we receive the following exception:
java.sql.SQLException: [Databricks]JDBCDriver Connection timeout expired. Details: None.
at com.databricks.client.jdbc.core.LoginTimeoutConnection.handleException(Unknown Source) ~[DatabricksJDBC42.jar:?]
at com.databricks.client.hivecommon.core.HiveJDBCCommonConnection.handleException(Unknown Source) ~[DatabricksJDBC42.jar:?]
at com.databricks.client.jdbc.core.LoginTimeoutConnection.connect(Unknown Source) ~[DatabricksJDBC42.jar:?]
at com.databricks.client.jdbc.common.BaseConnectionFactory.doConnect(Unknown Source) ~[DatabricksJDBC42.jar:?]
at com.databricks.client.jdbc.common.AbstractDriver.connect(Unknown Source) ~[DatabricksJDBC42.jar:?]
at java.sql.DriverManager.getConnection(DriverManager.java:681) ~[java.sql:?]
at java.sql.DriverManager.getConnection(DriverManager.java:190) ~[java.sql:?]
also we have tested different properties such as ConnectionTimeout=300;SocketTimeout=300 with jdbc url but still the above problem persists
How do we avoid this problem any help?
- Labels:
-
Azure databricks

