JDBC to delta lake: Is setting fetch size expected to be effective?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-16-2022 06:48 AM
I am using the databricks jdbc driver to access a delta lake. The database URL specifies transportMode=http. I have experimented with setting different values of fetchSize on the java.sqlPreparedStatement object and have monitored memory use within my application. I am getting inconclusive results.
Is this setting to have an effect at all in my set-up?
Labels:
- Labels:
-
Databricks JDBC Driver
-
Size
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-20-2022 06:08 AM
I think there is one spark configuration but I forgot right now
Pelase try to utilized this doc maybe you get something- https://spark.apache.org/docs/latest/configuration.html
AviralBhardwaj
