topic Re: EOFError trying to assign a model using a custom module in Machine Learning

EOFError trying to assign a model using a custom module

jdigiovanni — Thu, 21 Jul 2022 16:28:35 GMT

I'm in a Data Science Bootcamp, and the final case study includes data preprocessing (done), using a linear regression model on the data, then porting to SQL for visualization. The model build uses custom python code provided as part of the exercise. I've attached that code, and the two files that the code pickles.

Python command used:

model = absenteeism_model('/dbfs/FileStore/shared_uploads/1009276498.DIGIOVANN/model', '/dbfs/FileStore/shared_uploads/1009276498.DIGIOVANN/scaler')

Even with the explicit path provided to these files, I get the error below.

EOFError Traceback (most recent call last)

<command-725274> in <module>

----> 1 model = absenteeism_model('/dbfs/FileStore/shared_uploads/1009276498.DIGIOVANN/model', '/dbfs/FileStore/shared_uploads/1009276498.DIGIOVANN/scaler')

/dbfs/FileStore/shared_uploads/1009276498.DIGIOVANN/absenteeism_module.py in __init__(self, model_file, scaler_file)

41 with open('model','rb') as model_file, open('scaler', 'rb') as scaler_file:

42 self.reg = pickle.load(model_file)

---> 43 self.scaler = pickle.load(scaler_file)

44 self.data = None

EOFError: Ran out of input

Re: EOFError trying to assign a model using a custom module

Anonymous — Sat, 23 Jul 2022 08:50:39 GMT

https://community.databricks.com/s/question/0D53f00001HKIFUCA5/cluster-does-not-start-coursera-training-distributed-computing-with-spark-sql

Re: EOFError trying to assign a model using a custom module

Prabakar — Sun, 24 Jul 2022 20:36:08 GMT

It would be great if you could share the full stack trace to check what happened.

Re: EOFError trying to assign a model using a custom module

Vidula — Mon, 05 Sep 2022 12:54:30 GMT

Hi @Joe DiGiovanni

Just wanted to check in if you were able to resolve your issue or do you need more help? We'd love to hear from you.

Thanks!