thanks @Aman Sehgal​ ! I'll try this later this afternoon. do you happen to have a generic example or URL of the best practice way to implement in pyspark?

thanks