10-08-2021 02:19 AM
I am searching for the Databricks JDBC 2.6.19 documentation page. I can find release notes from the Databricks download page (https://databricks-bi-artifacts.s3.us-east-2.amazonaws.com/simbaspark-drivers/jdbc/2.6.19/docs/release-notes.txt) but on Magnitude's own Simba documentation I only find version 2.6.16 which does not even support Spark >= 3.0 (http://simba.wpengine.com/products/Spark/doc/JDBC_InstallGuide/content/jdbc/intro.htm). So where would I find the latest jdbc docs?
10-08-2021 04:54 PM
hi @Alexander Wagner ,
According to the docs from link the release version 2.6.16 shows that it has been added support for Spark 3.0.
For example, you will be able to find the following in the release notes:
2.6.16 -----------------------------------------------------------------------
Released 2020-07-31
Enhancements & New Features
* [SPARKJ-363] Custom HTTP headers
The driver now supports custom HTTP headers in connection URLs. For more
information, see the Installation and Configuration Guide.
* [SPARKJ-364] Updated third-party libraries
The JDBC 4.2 driver has been updated to use the following libraries:
- log4j 2.13.3
- slf4j 1.7.30
The JDBC 4.0 and 4.1 versions of the driver continue to use the previous
versions of these libraries.
* [SPARKJ-397] Support for Spark 3.0
The driver now supports Spark 3.0
Thanks
10-10-2021 10:33 PM
Hi @Jose Gonzalez ,
this makes no sense to me. From the official Simba docs it says 2.6.16 supports Spark up to 2.4, see http://simba.wpengine.com/products/Spark/doc/JDBC_InstallGuide/content/jdbc/requirements.htm. I don't trust the release notes to overrule official docs. Also my question was less about what is in the release notes but where to find the most current JDBC driver docs? I want to read the docs for version 2.6.19 but where are those? I don't consider release notes as docs.
Many thanks.
11-07-2021 10:35 PM
@Arjun Kaimaparambil Rajan Hi Arjun, sorry I missed your reply. Indeed, the direct download comes with the latest docs as pdf. This seems pretty archaic to me since now I have to send people PDFs so the can read the docs instead of pointing them to the html pages of the official documentation. Maybe Simba/Magnitude can improve that in the future. Thanks for your pointer.
11-07-2021 10:38 PM
By the way what is still wild, is that the Simba docs say 2.6.16 does only support until Spark 2.4 while the release notes on Databricks download page say 2.6.16 already supports Spark 3.0. Strange that we get contradicting info from the actual driver-making company.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group