cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there a known issue regarding Databricks JDBC driver character values such as Japanese etc?

151640
New Contributor III

A Parquet file contains character data for various languages and is shown by the Data Explorer UX. A simple "select *" query using the Databricks JDBC driver (version 2.6.29) with a tool such as SQLSquirrel displays invalid characters.

image

1 ACCEPTED SOLUTION

Accepted Solutions

151640
New Contributor III

The issue encountered has been confirmed to be a defect in the Databricks JDBC driver.

View solution in original post

5 REPLIES 5

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi @nigel campbell​ , Could you please look into https://community.databricks.com/s/question/0D53f00001LKG9ECAX/how-to-properly-load-unicode-utf8-cha... and let us know if this helps.

151640
New Contributor III

That thread doesn't address the issue. The driver should return valid values by default as do many other products. Appears to be a fairly significant defect.

Kaniz_Fatma
Community Manager
Community Manager

Hi @nigel campbell​, Please make sure 'file.encoding' is set to UTF-8 in the config file and see if the issue still persists.

Anonymous
Not applicable

Hi @nigel campbell​ 

Hope everything is going great.

Does @Kaniz Fatma​  and @Debayan Mukherjee​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks!

151640
New Contributor III

The issue encountered has been confirmed to be a defect in the Databricks JDBC driver.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!