https://community.databricks.com/t5/machine-learning/how-to-eval-the-accuracy-quality-of-a-llm/m-p/36128#M1880 <P>There aren't exact metrics to evaluate how LLM is accurate right now. Just make test questions have a large coverage could be a tip. I expect many people will work on it!</P> Thu, 29 Jun 2023 00:32:41 GMT Hyunkee 2023-06-29T00:32:41Z https://community.databricks.com/t5/machine-learning/how-to-eval-the-accuracy-quality-of-a-llm/m-p/36051#M1876 <P>extremely subjective (human responses on likert scale don't suffice and hard to quantify with one metric on accuracy). curious how others have approached this</P> Wed, 28 Jun 2023 23:35:10 GMT https://community.databricks.com/t5/machine-learning/how-to-eval-the-accuracy-quality-of-a-llm/m-p/36051#M1876 cloud712 2023-06-28T23:35:10Z https://community.databricks.com/t5/machine-learning/how-to-eval-the-accuracy-quality-of-a-llm/m-p/36128#M1880 <P>There aren't exact metrics to evaluate how LLM is accurate right now. Just make test questions have a large coverage could be a tip. I expect many people will work on it!</P> Thu, 29 Jun 2023 00:32:41 GMT https://community.databricks.com/t5/machine-learning/how-to-eval-the-accuracy-quality-of-a-llm/m-p/36128#M1880 Hyunkee 2023-06-29T00:32:41Z