NandiniN
Databricks Employee
Databricks Employee

https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html

 

numPartitions (none) The maximum number of partitions that can be used for parallelism in table reading and writing. This also determines the maximum number of concurrent JDBC connections. If the number of partitions to write exceeds this limit, we decrease it to this limit by calling coalesce(numPartitions) before writing.

read/write