- 3566 Views
- 4 replies
- 1 kudos
Resolved! Tuning `CrossValidator` spark job performance
I am running a 3-fold cross validation of an ML pipeline that utilizes `GBTClassifier` as the final step. It takes 18 hours to run and I am looking for feedback into how to improve the performance as I expect this to go faster.For context here is the...
- 3566 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Assaad Mrad​ , Just a friendly follow-up. Do you still need help, or @Chris Chalcraft​ 's response help you to find the solution? Please let us know.
- 1 kudos
- 1341 Views
- 0 replies
- 2 kudos
2021-08-Best-Practices-for-Your-Data-Architecture-v3-OG-1200x628
Thanks to everyone who joined the Best Practices for Your Data Architecture session on Optimizing Data Performance. You can access the on-demand session recording here and the pre-run performance benchmarks using the Spark UI Simulator. Proper cluste...
- 1341 Views
- 0 replies
- 2 kudos