Ramana
Valued Contributor II

spark_partition_id is the closest and most performant function available as an alternative, and I migrated to use this function. So far, no issues.

https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.functions.spar...

 

Thanks
Ramana

View solution in original post