cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Vish1
by New Contributor II
  • 3981 Views
  • 3 replies
  • 1 kudos

pyspark: Stage failure due to One hot encoding

I am facing the below error while fitting my model. I am trying to run a model with cross validation with a pipeline inside of it. Below is the code snippet for data transformation:qd = QuantileDiscretizer(relativeError=0.01, handleInvalid="error", n...

image
  • 3981 Views
  • 3 replies
  • 1 kudos
Latest Reply
shyam_9
Valued Contributor
  • 1 kudos

Hi @Vishnu P​, could you please share the full stack trace? Also, observe how the workers memory utilizing?

  • 1 kudos
2 More Replies
ashrafkhan94
by New Contributor II
  • 1051 Views
  • 2 replies
  • 2 kudos

Resolved! Failure in mlflow.spark.load_model : Random Forrest pretrained model

model = mlflow.spark.load_model(model_uri=f"models:/{model_name}/{model_version}")Log:An error occurred while calling o2861.load.: org.apache.spark.SparkException: Job aborted due to stage failure: Task 4 in stage 4599.0 failed 4 times, most recent f...

  • 1051 Views
  • 2 replies
  • 2 kudos
Latest Reply
Noopur_Nigam
Valued Contributor II
  • 2 kudos

Hi @Ashraf Khan​ Did you get a chance to look into Sean's response. Please let us know if you need more help on this.

  • 2 kudos
1 More Replies
Labels