LLM experience in production

[w_silveira]

Are LLMs really ready for production deployment?

[abetogi · Accepted solution]

Based on the KeyNote examples there are many relevant companies showing very complex data LLMs. I am assuming many of them use that in prod and therefore ready for usage. 

[GKH]

We have been facing issues serving even simple models in production:
https://community.databricks.com/t5/machine-learning/errors-using-dolly-deployed-as-a-rest-api/m-p/3...