Unable to create an endpoint serving for transformer model (hugginface)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-04-2024 10:29 PM
Hello
I am trying to create a text classification model based on this blog https://www.databricks.com/blog/rapid-nlp-development-databricks-delta-and-transformers and the notebook accelerator.
I just changed the model to take a french bert but i cannot serve the model the only error i got is this one :
Served model creation aborted for served model `transformer_models-3`, config version 9, since the update timed out.
Thank you for your help
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-05-2024 06:06 AM
Hello Anasse, the LLM landscape has changed drastically since that blog was released in mid-2022. We have new, updated guidance which you can find here (make sure you check out the Next Steps section for the RAG Demo link as well). Additionally, if you're interested in French, can I recommend mixtral, examples of which you can find here?
