Java 21 support with Databricks JDBC driver

[NathanE]

Hello,

I was wondering if there was any timeline for Java 21 support with the Databricks JDBC driver (current version is 2.34).

One of the required change is to update the dependency to arrow to version 13.0 (current version is 9.0.0).

The current workaround is to disable arrow in the connection string with `EnableArrow=0` but I would like to still be able to use arrow serialization.

Regards

[Kaniz_Fatma]

Hi @NathanE , 

As of now, there is no official timeline for Java 21 support with Databricks JDBC driver, and the latest version of the JDBC driver (2.34) still uses Arrow 9.0.0. However, Databricks is actively working to update the JDBC driver to support the latest Arrow version, which includes support for Java 21.

In the meantime, if you want to use Arrow serialization with the Databricks JDBC driver, you can continue to use the workaround of disabling Arrow by setting EnableArrow=0 in the connection string. Disabling Arrow will not affect the functionality of the JDBC driver, but it may affect performance and memory usage.

Once Databricks releases an updated version of the JDBC driver with support for Arrow 13.0 and Java 21, you can upgrade to the latest version to take advantage of the new features and improvements.

[ziv_cohen]

Hi,

Is there a committed date when this issue will be fixed? 

Toggling off Arrow creates 70% performance degradation in our benchmark and it's unacceptable.  

Waiting for your update.

Thanks in advance. 

[Fabich]

Hello @Kaniz_Fatma 

Any update on this topic of Java 21 ? Any timeline ?

Our clients really want to upgrade to Java 21 and we don't want to disable Arrow for performance reasons