UmaMahesh1
Honored Contributor III

Can you also give the number of partitions the df has ?

you can use df.rdd.getNumPartitions()

Uma Mahesh D