Errors when querying Azure DataBricks through DBeaver on macos
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-16-2022 04:30 AM
Configured DBeaver to work with either databricks latest driver or simba. I can connect and see databases, schemas, tables and columns. However, when a select statement is executed 30-40 seconds go by before I get the following error message:
SQL Error [500540] [HY000]: [Databricks][DatabricksJDBCDriver](500540) Error caught in BackgroundFetcher. Foreground thread ID: 44. Background thread ID: 51. Error caught: sun.misc.Unsafe or java.nio.DirectByteBuffer.<init>(long, int) not available.
Any ideas ? Was this behavior encountered by others?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-17-2022 05:55 AM
Hello @George Petrou
Could you please try setting the below Spark configuration on the cluster?
spark.driver.extraJavaOptions -Dio.netty.tryReflectionSetAccessible=true
spark.executor.extraJavaOptions -Dio.netty.tryReflectionSetAccessible=true
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-12-2022 07:56 AM
Has this issue been resolved? @aravhish solution did not help me. Any other options?
I am experiencing the exact same issue with the same configuration on a Mac. Much help would be appreciated.