topic Re: Errors when querying Azure DataBricks through DBeaver on macos in Data Engineering

Errors when querying Azure DataBricks through DBeaver on macos

GeorgeP — Thu, 16 Jun 2022 11:30:59 GMT

Configured DBeaver to work with either databricks latest driver or simba. I can connect and see databases, schemas, tables and columns. However, when a select statement is executed 30-40 seconds go by before I get the following error message:

SQL Error [500540] [HY000]: [Databricks][DatabricksJDBCDriver](500540) Error caught in BackgroundFetcher. Foreground thread ID: 44. Background thread ID: 51. Error caught: sun.misc.Unsafe or java.nio.DirectByteBuffer.<init>(long, int) not available.

Any ideas ? Was this behavior encountered by others?

Re: Errors when querying Azure DataBricks through DBeaver on macos

User16764241763 — Fri, 17 Jun 2022 12:55:18 GMT

Hello @George Petrou

Could you please try setting the below Spark configuration on the cluster?

spark.driver.extraJavaOptions -Dio.netty.tryReflectionSetAccessible=true

spark.executor.extraJavaOptions -Dio.netty.tryReflectionSetAccessible=true

Re: Errors when querying Azure DataBricks through DBeaver on macos

sage5616 — Tue, 12 Jul 2022 14:56:18 GMT

Has this issue been resolved? @aravhish solution did not help me. Any other options?

I am experiencing the exact same issue with the same configuration on a Mac. Much help would be appreciated.