cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Error using score_batch for batch inference

Ariane
New Contributor II

Hey everybody,

I have been learning to use the Databricks feature store and I was trying to train the model using the stored features and compute batch inference. 

I am getting an error though, running prediction using score_batch, I have been getting this error for the past two days and I have tried everything its still not resolving.  I have checked my input batch dataframe(spark_df), and there are no null values, no infinite values, and no values that are beyond the float 32. Something am I missing?

Ariane_0-1692892706534.png

 

2 REPLIES 2

Kumaran
Valued Contributor III
Valued Contributor III

Hi @Ariane,

Thank you for posting your question in the Databricks community.

If you are using the RandomForestRegressorCould you check by setting maxDepth it to the default value to mitigate this issue?

Ariane
New Contributor II

Hey @Kumaran

I am using a Random forest classifier however I have tried to set the max depth to none since it is the default value but the error still exists. 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.