cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Does Spark MLlib support Generalized Additive Modeling? How does one go about implementing GAM models in Spark?

Pavan1
New Contributor II

I want to implement GAM (Generalized additive model) model in Spark. Based on my research on online forums, I could not find the implementation of GAM models on Spark. Has anyone in this community attempted this? Does Spark MLlib support GAM?

1 ACCEPTED SOLUTION

Accepted Solutions

Kaniz
Community Manager
Community Manager

Hi @Pavan Kumar​, Please read this and let us know if that helps.

View solution in original post

3 REPLIES 3

Kaniz
Community Manager
Community Manager

Hi @Pavan Kumar​, Please read this and let us know if that helps.

Pavan1
New Contributor II

Hi @Kaniz Fatma​, thanks for sharing this. We ended up using pyGAM library in Python for this. This PDF is a good introduction. I will share my learnings once we complete our experiments.

Kaniz
Community Manager
Community Manager

Excellent, Thanks for the update @Pavan Kumar​!

Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.