topic Re: No saved model after stopping the cluster. in Machine Learning

No saved model after stopping the cluster.

Somi — Fri, 24 Jun 2022 18:07:35 GMT

I have saved a keras model in some directories in dbfs to load and retrain that with more data, etc. The problem is that when cluster stops and restarts, seems those directories and model are no longer available there and it starts training a new model.

Any idea?

Re: No saved model after stopping the cluster.

jose_gonzalez — Tue, 05 Jul 2022 20:26:12 GMT

Hi @Somayeh Abniki,

Are you using the community edition or you are running your job on DBR with ML? could you share some code snippet? any errors messages? please try to provide more details.

Re: No saved model after stopping the cluster.

Vidula — Fri, 02 Sep 2022 03:14:40 GMT

Hi @Somayeh Abniki

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: No saved model after stopping the cluster.

Somi — Fri, 02 Sep 2022 19:58:50 GMT

Hi @Vidula Khanna

I figured it out by replacing OS library module with dbutils utilities. It looks like mre compatible with DBFS.