Identifying the right tools for the job

[UM]

Hi all, thank you for taking the time to attend to my post. A background to preface, my team and I have been prototyping an ML model that we would like to push into the production and deployment phase. We have been prototyping on Jupyter Notebooks but are trying to figure out what tools and platforms we may require.

I'm by no means an expert in data architecture and was hoping someone could shed some light. In the diagram attached, is my understanding of it thus far (implying that something like Databricks and Sagemaker is an all in one platform) However, I'm not sure if they have functionalities like:

• version control
• parameterization of the notebooks
• templatizing notebooks

Hope to hear back! And participate in an active discussion! Thank you so much!

[Kaniz]

Hi @ UM! My name is Kaniz, and I'm the technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question first. Or else I will get back to you soon. Thanks.

[-werners-]

It is hard to tell what you need. Are you gonna use spark?

[Dan_Z · Accepted solution]

For production model serving, why not just use MLflow Model Serving? You just code it up/import it with the notebooks, then Log it using MLflow, then Register it with the MLflow Registry, then there is a nice UI to serve it using Model Serving. It will expose a REST endpoint for your model that any application can hit.

[Kaniz]

Hi @Eu jin Lee​ , Just a friendly follow-up. Do you still need help, or do the above responses help you find the solution? Please let us know.