cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

JDBC to delta lake: Is setting fetch size expected to be effective?

SebastianM
New Contributor

I am using the databricks jdbc driver to access a delta lake. The database URL specifies transportMode=http. I have experimented with setting different values of fetchSize on the java.sqlPreparedStatement object and have monitored memory use within my application. I am getting inconclusive results.

Is this setting to have an effect at all in my set-up?

1 REPLY 1

Aviral-Bhardwaj
Esteemed Contributor III

I think there is one spark configuration but I forgot right now

Pelase try to utilized this doc maybe you get something- https://spark.apache.org/docs/latest/configuration.html

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.