topic LLM experience in production in Machine Learning https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/36241#M1885 <P>Are LLMs really ready for production deployment?</P> Thu, 29 Jun 2023 18:24:51 GMT w_silveira 2023-06-29T18:24:51Z LLM experience in production https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/36241#M1885 <P>Are LLMs really ready for production deployment?</P> Thu, 29 Jun 2023 18:24:51 GMT https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/36241#M1885 w_silveira 2023-06-29T18:24:51Z Re: LLM experience in production https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/36245#M1886 <P><SPAN>Based on the KeyNote examples there are many relevant companies showing very complex data LLMs. I am assuming many of them use that in prod and therefore ready for usage.&nbsp;</SPAN></P> Thu, 29 Jun 2023 18:28:16 GMT https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/36245#M1886 abetogi 2023-06-29T18:28:16Z Re: LLM experience in production https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/37406#M1940 <P>We have been facing issues serving even simple models in production:<BR /><A href="https://community.databricks.com/t5/machine-learning/errors-using-dolly-deployed-as-a-rest-api/m-p/37405#M1939" target="_blank" rel="noopener">https://community.databricks.com/t5/machine-learning/errors-using-dolly-deployed-as-a-rest-api/m-p/37405#M1939</A></P> Tue, 11 Jul 2023 23:03:26 GMT https://community.databricks.com/t5/machine-learning/llm-experience-in-production/m-p/37406#M1940 GKH 2023-07-11T23:03:26Z