LLM experience in production

w_silveira
New Contributor II

Are LLMs really ready for production deployment?

abetogi
New Contributor III

Based on the KeyNote examples there are many relevant companies showing very complex data LLMs. I am assuming many of them use that in prod and therefore ready for usage. 

View solution in original post

GKH
New Contributor II

We have been facing issues serving even simple models in production:
https://community.databricks.com/t5/machine-learning/errors-using-dolly-deployed-as-a-rest-api/m-p/3...