- 2624 Views
- 3 replies
- 4 kudos
Are UDFs necessary for applying models from ML libraries at scale ?
Hello,I recently finished the "scalable machine learning with apache spark" course and saw that SKLearn models could be applied faster in a distributed manner when used in pandas UDFs or with mapInPandas() method. Spark MLlib models don't need this k...
- 2624 Views
- 3 replies
- 4 kudos
- 4 kudos
MlLib is in the maintenance model and udf is not used by creating model in most cases
- 4 kudos
- 5336 Views
- 4 replies
- 7 kudos
Resolved! No Module named 'mlflow'
I new to the scalable machine learning with apache spark course. I am in the notebook ML 00a - Install Datasets it includes one cell (attached) which throws an error 'no module named 'mlflow''. It attempts to run the Classroom-Setup file. Error is th...
- 5336 Views
- 4 replies
- 7 kudos
- 7 kudos
@Myles Pember​ I hope the suggestions above helped out! If so, please select one as 'best' for us!If you still need assistance, let us know!
- 7 kudos