topic Re: Java 21 support with Databricks JDBC driver in Data Engineering

Java 21 support with Databricks JDBC driver

NathanE — Mon, 16 Oct 2023 11:27:10 GMT

Hello,

I was wondering if there was any timeline for Java 21 support with the Databricks JDBC driver (current version is 2.34).

One of the required change is to update the dependency to arrow to version 13.0 (current version is 9.0.0).

The current workaround is to disable arrow in the connection string with `EnableArrow=0` but I would like to still be able to use arrow serialization.

Regards

Re: Java 21 support with Databricks JDBC driver

Fabich — Mon, 08 Jan 2024 15:29:06 GMT

Hello @Retired_mod

Any update on this topic of Java 21 ? Any timeline ?

Our clients really want to upgrade to Java 21 and we don't want to disable Arrow for performance reasons

Re: Java 21 support with Databricks JDBC driver

ziv_cohen — Sun, 09 Jun 2024 09:42:46 GMT

Hi,

Is there a committed date when this issue will be fixed?

Toggling off Arrow creates 70% performance degradation in our benchmark and it's unacceptable.

Waiting for your update.

Thanks in advance.

Re: Java 21 support with Databricks JDBC driver

loicmathieu — Tue, 09 Jul 2024 13:27:55 GMT

Hi,
Any news on this topic?
We recently upgraded to Java 21 (which is out since 1 months) and we had to disable Arrow which is not good for performance.

Re: Java 21 support with Databricks JDBC driver

Oleksandr_K — Mon, 29 Jul 2024 08:32:09 GMT

Hi, this issue blocks us from updating Java 21, which is critical for addressing security issues. Please, update on the timelines, please.

Re: Java 21 support with Databricks JDBC driver

151640 — Fri, 09 Aug 2024 23:11:59 GMT

Regarding EnableArrow, it is not discussed in the PDF SIMBA distributes with the driver, it is buried in the release notes.txt file.

It may be required to avoid corrupted character values being returned from the driver. This can occur with JRE 8.

Hopefully the SIMBA/Databricks PM for the driver will review docs etc.

Re: Java 21 support with Databricks JDBC driver

yunbodeng — Sat, 15 Mar 2025 16:43:00 GMT

You can download the latest Databricks JDBC here (https://www.databricks.com/spark/jdbc-drivers-download) in which the latest Arrow version is 17 (https://databricks-bi-artifacts.s3.us-east-2.amazonaws.com/simbaspark-drivers/jdbc/2.7.1/docs/release-notes.txt).

We encourage you not to turn off Arrow, which has severe performance degradation. Instead, you can apply the following JVM parameters, as it is also called out in the driver configuration and installation guide (https://docs.databricks.com/aws/en/assets/files/Databricks-JDBC-Driver-Install-and-Configuration-Guide-c0612566d2798385778d33e87581fb7b.pdf, or you can find it embedded in the driver package).

--add-opens java.base/java.nio=ALL-UNNAMED

Re: Java 21 support with Databricks JDBC driver

yunbodeng — Sat, 15 Mar 2025 16:44:29 GMT

Try to apply the following JVM parameters:

--add-opens java.base/java.nio=ALL-UNNAMED