Hi @DattaWalake ,

Thanks for sharing this. This is super important topic. I've seen a lot of folks generating columns within for loops using withColumn approach and as you can guess it was disaster in terms of performance.