NandiniN
Databricks Employee
Databricks Employee

Hey @spicysheep , 

I see you are getting failed barrier ResultStage error during distributed SparkXGBRanker training.

I believe it is a limitation using standard cluster, hence distributed tasks are not working there. 

Reference https://www.databricks.com/blog/2020/11/16/how-to-train-xgboost-with-spark.html, it mentions to use GPU instance.

I also see the limitation on https://docs.databricks.com/aws/en/compute/standard-limitations

Thanks!