- 1245 Views
- 1 replies
- 0 kudos
- 1245 Views
- 1 replies
- 0 kudos
- 0 kudos
If you are talking about distributed training of a single XGBoost model, there is no built-in capability in SparkML. SparkML supports gradient boosted trees, but not XGBoost specifically. However, there are 3rd party packages, such as XGBoost4J that ...
- 0 kudos
- 13286 Views
- 1 replies
- 0 kudos
How can I add jars ("spark.jars") to pyspark notebook?
I want to add a few custom jars to the spark conf. Typically they would be submitted along with the spark-submit command but in Databricks notebook, the spark session is already initialized. So, I want to set the jars in "spark.jars" property in the...
- 13286 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @dbansal, Install the libraries/jars while initialising the cluster.Please go through the documentation on the same below,https://docs.databricks.com/libraries.html#upload-a-jar-python-egg-or-python-wheel
- 0 kudos