Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-03-2025 09:09 PM
Hey @spicysheep ,
I see you are getting failed barrier ResultStage error during distributed SparkXGBRanker training.
I believe it is a limitation using standard cluster, hence distributed tasks are not working there.
Reference https://www.databricks.com/blog/2020/11/16/how-to-train-xgboost-with-spark.html, it mentions to use GPU instance.
I also see the limitation on https://docs.databricks.com/aws/en/compute/standard-limitations
Thanks!