topic Re: Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc? in Data Engineering

Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc?

151640 — Wed, 02 Nov 2022 16:45:21 GMT

A Parquet file contains character data for various languages and is shown by the Data Explorer UX. A simple "select *" query using the Databricks JDBC driver (version 2.6.29) with a tool such as SQLSquirrel displays invalid characters.

Re: Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc?

151640 — Thu, 03 Nov 2022 10:26:43 GMT

That thread doesn't address the issue. The driver should return valid values by default as do many other products. Appears to be a fairly significant defect.

Re: Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc?

Anonymous — Tue, 17 Jan 2023 05:59:42 GMT

Hi @nigel campbell

Hope everything is going great.

Does @Kaniz Fatma and @Debayan Mukherjee response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks!

Re: Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc?

151640 — Tue, 17 Jan 2023 12:15:24 GMT

The issue encountered has been confirmed to be a defect in the Databricks JDBC driver.

Re: Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc?

Debayan — Thu, 03 Nov 2022 06:41:40 GMT

Hi @nigel campbell , Could you please look into https://community.databricks.com/s/question/0D53f00001LKG9ECAX/how-to-properly-load-unicode-utf8-characters-from-table-over-jdbc-connection-using-simba-spark-driver and let us know if this helps.