Hi @Gopal B​ Photon can't be effective in all the cases. It will be of good effect when you have good amount of joins and aggregations happening in your logic. But in your case, it seems to be a simple read and write.

Also see if you can reduce the number of workers and have one or two large cluster with more cores and memory like 4XL, so that you can avoid shuffles. But Please see at which point, you are taking time as I see from your job log, only one task is running.