Hi @RiyazAliM 

i just want want to decrease the job time so that why i was using repartition,batch size,num partiton, but i did not work can you please suggest correct code this my worker node details 

1-2 Workers32-64 GB Memory4-8 Cores
1 Driver32 GB Memory, 4 Cores
Runtime14.3.x-scala2.12