https://community.databricks.com/t5/technical-blog/mlops-gym-evaluating-large-language-models-with-mlflow/ba-p/72815 <P><SPAN><span class="lia-inline-image-display-wrapper lia-image-align-center" image-alt="image (9).png" style="width: 510px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8307i32D6FA4291F9F184/image-dimensions/510x291?v=v2" width="510" height="291" role="button" title="image (9).png" alt="image (9).png" /></span></SPAN></P> <P><FONT size="4"><EM>This is the second part of a three-part guide on MLflow in the MLOps Gym series. In Part 1, “<A href="https://community.databricks.com/t5/technical-blog/mlops-gym-beginners-guide-to-mlflow/ba-p/62593" target="_blank" rel="noopener">Beginners’ Guide to MLflow</A>”, we covered Tracking and Model Registry components. In this article, we will focus on the <STRONG>Evaluate</STRONG></EM><SPAN><EM> component, which is one of the MLflow tools designed to aid in Large Language Model Operations. The remaining components, AI Gateway and Prompt Engineering UI, will be covered in Part 3.&nbsp;</EM><BR /><BR /></SPAN></FONT></P> <P><LI-TOC indent="15" liststyle="disc" maxheadinglevel="2"></LI-TOC></P> <H1><SPAN><BR />What is LLMOps and why is it important?</SPAN></H1> <P><SPAN>LLMOps, or Large Language Model Operations, is an emerging area in the field of artificial intelligence that focuses on the deployment, monitoring, management, and scaling of large language models (LLMs) like DBRX, Llama3, GPT-4, BERT, and more. LLMs have shown remarkable capabilities in understanding and generating human-like text, which makes them incredibly valuable across various applications such as chatbots, content creation, and language translation. However, the complexity of these models, coupled with their substantial computational requirements, necessitates specialized operational strategies to utilize them effectively.</SPAN></P> <P><SPAN>Databricks is built with LLMOps in mind by integrating open-source tooling, such as </SPAN><A href="https://mlflow.org/" target="_blank" rel="noopener"><SPAN>MLflow</SPAN></A><SPAN>, to streamline the operational aspects of large language models. Databricks alleviates common problems arising from intensive resource consumption, the need for ongoing training, difficulties with evaluating outputs, and the management of ethical considerations such as bias and fairness. The platform's native support for popular ML frameworks used in LLM development, alongside MLflow's capabilities for experiment tracking, model versioning, and lifecycle management, equips teams to effectively train, deploy, and monitor LLMs at scale. Additionally, Unity Catalog allows for tight governance across all data assets, lineage tracking, feature tables, and much more.&nbsp;</SPAN></P> <H3><SPAN>How is LLMOps different than MLOps</SPAN></H3> <P><SPAN>LLMOps represents a specialized subset within the broader domain of MLOps, which is concerned with the end-to-end lifecycle management of Machine Learning systems. LLMOps focuses specifically on the unique challenges posed by large language models. Here are the top challenges when operationalizing LLMs:</SPAN><SPAN><BR /></SPAN></P> <UL> <LI style="font-weight: 400;" aria-level="1"><STRONG>Size of models and data</STRONG><SPAN>: LLMs are characterized by their vast number of parameters, enormous data requirements, and significant computational resources for training and inference. It is also difficult to properly track model outputs and evaluate overall performance. </SPAN><SPAN><BR /><BR /></SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><STRONG>Working with unstructured data</STRONG><SPAN>: In contrast to general MLOps, LLMOps deals with intricacies like managing the extensive preprocessing pipelines for text data.</SPAN><SPAN><BR /><BR /></SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><STRONG>Different training techniques</STRONG><SPAN>: Modeling for LLMs differ from traditional machine learning in scale, architecture, generalization, context handling, and reliance on transfer learning. Ensuring data privacy in language models, handling the complexities of transfer learning and fine-tuning on domain-specific information, and dealing with the nuances of natural language understanding and generation are challenges that are specific to LLMOps. </SPAN><SPAN><BR /><BR /></SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><STRONG>Responsible AI:</STRONG><SPAN> Additionally, LLMOps must consider the ethical implications and potential biases within language models, emphasizing the importance of responsible AI practices.</SPAN></LI> </UL> <H3><SPAN>Databricks, MLflow, and GenAI</SPAN></H3> <P><SPAN>MLflow has grown to include many tools for working with LLMs including native flavors for some of the most popular packages. These </SPAN><A href="https://mlflow.org/docs/latest/llms/index.html#explore-the-native-llm-flavors" target="_blank" rel="noopener"><SPAN>flavors</SPAN></A><SPAN> include Transformers (HuggingFace), OpenAI, Sentence Transformers, and Langchain!&nbsp;</SPAN></P> <P><SPAN>Langchain Flavor:</SPAN></P> <TABLE style="height: 83px; border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%" height="83px"><LI-CODE lang="python">with mlflow.start_run(): model_info = mlflow.langchain.log_model(chain, "langchain_model")</LI-CODE></TD> </TR> </TBODY> </TABLE> <P>Transformers Flavor (HuggingFace):</P> <TABLE style="border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%"><LI-CODE lang="python">with mlflow.start_run(): model_info = mlflow.transformers.log_model( transformers_model=generation_pipeline, artifact_path="text_generator", input_example=input_example, signature=signature, ) </LI-CODE></TD> </TR> </TBODY> </TABLE> <P><SPAN>Complementing the advancements of MLflow, Databricks has released a breadth of documentation and blogs including the </SPAN><A href="https://www.databricks.com/resources/ebook/the-big-book-of-mlops" target="_blank" rel="noopener"><SPAN>Big Book of MLOps</SPAN></A><SPAN> which includes information on generative AI, RAG, and more.<BR /><BR /></SPAN><SPAN>Now, let’s start going deeper into the concepts mentioned already, starting with LLM Evaluation.&nbsp;<BR /><BR /></SPAN></P> <H1><SPAN>Evaluation</SPAN></H1> <P><SPAN>Large Language Models have changed the technologic landscape immensely, but how do we decide which models to use? Which prompts are determined to be </SPAN><I><SPAN>good</SPAN></I><SPAN>? How do we make sure that we are using models correctly and efficiently? </SPAN><SPAN><BR /></SPAN><SPAN><BR /></SPAN><SPAN>Evaluating LLMs is a continuously evolving field, but MLflow makes it easy to aggregate metrics and even use additional LLMs to judge the outputs of your existing models. Using </SPAN><FONT face="courier new,courier"><SPAN>mlflow.evaluate()</SPAN></FONT><SPAN> we can use specific configurations for our evaluator to gather key information about our models’ performance.&nbsp;</SPAN></P> <P><SPAN>Let’s take a deeper look.&nbsp;</SPAN></P> <H2><SPAN>Calculating and Collecting Metrics</SPAN></H2> <P><SPAN>MLflow has a number of default evaluators for specific model types including question-answering, text-summarization, text-generation, and retrievers. You can invoke these evaluators by calling </SPAN><FONT face="courier new,courier"><SPAN>mlflow.evaluate()</SPAN></FONT><SPAN> and setting the </SPAN><FONT face="courier new,courier"><SPAN>model_type</SPAN></FONT><SPAN> parameter, as seen in the following code snippet.&nbsp;</SPAN></P> <TABLE style="border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%" height="101px"><LI-CODE lang="python">mlflow.evaluate( model=logged_model.model_uri, model_type="question-answering", data=questions ) </LI-CODE></TD> </TR> </TBODY> </TABLE> <P><SPAN>Function-based metrics measure the effectiveness of LLMs in NLP tasks by taking into consideration toxicity, quality of text, readability, relevance, etc. These metrics assess the models' ability to predict correct outcomes, handle errors, and provide meaningful results in tasks like sentiment analysis, named entity recognition, part-of-speech tagging, machine translation, and language modeling.</SPAN><SPAN><BR /></SPAN><SPAN><BR /></SPAN><SPAN>By default, MLflow will collect function-based </SPAN><A href="https://mlflow.org/docs/latest/llms/llm-evaluate/index.html#use-default-metrics-for-pre-defined-model-types" target="_blank" rel="noopener"><SPAN>metrics</SPAN></A><SPAN> associated with the <FONT face="courier new,courier">model_type</FONT> and surface them within your experiment along with the rest of the run information:</SPAN></P> <P><span class="lia-inline-image-display-wrapper lia-image-align-center" image-alt="Will_Smith_8-1718206724894.png" style="width: 656px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8310i73AD4B3D8410982F/image-dimensions/656x667?v=v2" width="656" height="667" role="button" title="Will_Smith_8-1718206724894.png" alt="Will_Smith_8-1718206724894.png" /></span></P> <P><SPAN>Some of the common metrics include:</SPAN></P> <UL> <LI style="font-weight: 400;" aria-level="1"><SPAN>Exact-match - This metric measures the percentage of predictions that exactly match the ground truth, often used in question-answering tasks.</SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>Toxicity - This metric measures the level of toxicity in a text, often used in content moderation to ensure language models do not generate harmful content.</SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><A href="https://huggingface.co/spaces/evaluate-metric/rouge" target="_blank" rel="noopener"><SPAN>ROUGE</SPAN></A><SPAN> - This metric stands for Recall-Oriented Understudy for Gisting Evaluation and is used to automatically determine the quality of summaries by comparing them to reference summaries.</SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>ARI Grade Level - This is a readability metric that estimates the U.S. grade level (1-12) needed to understand a text. It's used to evaluate the readability of generated text, ensuring it's appropriate for the intended audience.</SPAN></LI> </UL> <H3><SPAN>Function-Based Custom Metrics</SPAN></H3> <P><SPAN>Additionally, you can create custom function-based metrics that you can define to log specific metrics within your runs. For example, latency is defined as the time it takes to generate a prediction for a given input. This is important when determining if the model is fast enough for a given application or if we need to rethink our model selection, and we can include latency in our evaluation by passing </SPAN><FONT face="courier new,courier"><SPAN>mlflow.metrics.latency()</SPAN></FONT><SPAN> to </SPAN><FONT face="courier new,courier">extra_metrics</FONT><SPAN>:</SPAN></P> <TABLE style="border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%"><LI-CODE lang="python">results = mlflow.evaluate( model, eval_data, targets="ground_truth", model_type="question-answering", extra_metrics=[mlflow.metrics.latency()], ) </LI-CODE></TD> </TR> </TBODY> </TABLE> <P><SPAN>You can remove the </SPAN><SPAN>model_type</SPAN><SPAN> if you want to log </SPAN><STRONG>only</STRONG><SPAN> your custom metrics. The </SPAN><A href="https://mlflow.org/docs/latest/python_api/mlflow.html#mlflow.evaluate" target="_blank" rel="noopener"><SPAN>MLflow documentation</SPAN></A><SPAN> provides more information about the supported evaluation metrics.</SPAN></P> <H2><SPAN>LLM-as-a-Judge</SPAN></H2> <P><SPAN>An alternative approach to evaluating LLMs is to utilize an LLM-as-a-judge. This method involves using the output from your model and generating scores based on the defined metric for the LLM judge. Evaluating LLMs using other LLM judges has become a prominent research topic. Our insights on this topic are presented in the blog post </SPAN><A href="https://www.databricks.com/blog/LLM-auto-eval-best-practices-RAG" target="_blank" rel="noopener"><SPAN>Best Practices for LLM Evaluation of RAG Applications</SPAN></A><SPAN>.&nbsp;</SPAN></P> <P><SPAN>MLflow has the capability to capture metrics generated by other LLMs. Currently, you can measure:</SPAN><SPAN><BR /></SPAN></P> <UL> <LI style="font-weight: 400;" aria-level="1"><SPAN>answer_similarity - measures how </SPAN><STRONG>similar</STRONG><SPAN> output is to provided </SPAN><STRONG>ground_truth</STRONG></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>answer_correctness - measures how </SPAN><STRONG>factually</STRONG> <STRONG>correct</STRONG><SPAN> the output is based on </SPAN><STRONG>ground_truth</STRONG></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>answer_relevance - measures how relevant the output is to the </SPAN><STRONG>input</STRONG><SPAN> prompt </SPAN><STRONG>only</STRONG></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>relevance - measures how relevant the output is to both the </SPAN><STRONG>input</STRONG><SPAN> and </SPAN><STRONG>context</STRONG></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>faithfulness - measures how faithful the model is to the </SPAN><STRONG>context</STRONG></LI> </UL> <P><SPAN>You can configure these metrics by first using </SPAN><FONT face="courier new,courier"><SPAN>mflow.metrics.genai</SPAN></FONT><SPAN> to import the appropriate metrics, associate an LLM (we are using Databricks Foundation Models API), and pass the information to</SPAN><FONT face="courier new,courier"><SPAN> mlflow.evaluate()</SPAN></FONT><SPAN>:<BR /></SPAN><SPAN><BR /></SPAN></P> <TABLE style="border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%"><LI-CODE lang="python">from mlflow.metrics.genai import relevance, EvaluationExample relevance_metric = relevance(model="endpoints:/databricks-llama-2-70b-chat") results = mlflow.evaluate( model, eval_df, targets="ground_truth", model_type="question-answering", evaluators="default", predictions="result", extra_metrics=[faithfulness_metric, relevance_metric, mlflow.metrics.latency()], evaluator_config={ "col_mapping": { "inputs": "questions", "context": "source_documents", } }, ) results.tables["eval_results_table"]</LI-CODE></TD> </TR> </TBODY> </TABLE> <P><SPAN>Output table split into two images for readability:</SPAN></P> <P><span class="lia-inline-image-display-wrapper lia-image-align-center" image-alt="Will_Smith_9-1718206944993.png" style="width: 999px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8311iC93BA883536EF36D/image-size/large?v=v2&amp;px=999" role="button" title="Will_Smith_9-1718206944993.png" alt="Will_Smith_9-1718206944993.png" /></span></P> <H3><SPAN><BR /></SPAN><SPAN>Custom GenAI Metrics</SPAN></H3> <P><SPAN>You can also create custom LLM-as-a-judge metrics within MLflow using </SPAN><FONT face="courier new,courier"><A href="http://mlflow.metrics.genai.make_genai_metric" target="_blank" rel="noopener"><SPAN>mlflow.metrics.genai.make_genai_metric()</SPAN></A></FONT><SPAN>.</SPAN><SPAN> You can do this by first creating an </SPAN><FONT face="courier new,courier"><SPAN>EvaluationExample</SPAN></FONT><SPAN>.</SPAN></P> <P><SPAN>Note: You can access the full notebook examples </SPAN><A href="https://mlflow.org/docs/latest/llms/llm-evaluate/notebooks/question-answering-evaluation.html" target="_blank" rel="noopener"><SPAN>here</SPAN></A><SPAN>.</SPAN></P> <TABLE style="height: 336px; border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%" height="336px"><LI-CODE lang="python">example = EvaluationExample( input="What is MLflow?", output=("MLflow is an open-source platform for managing machine "), score=4, justification=( "The definition effectively explains what MLflow is " "its purpose, and its developer. It could be more concise for a 5-score.", ), grading_context={ "targets": ( "MLflow is an open-source platform for managing " "the end-to-end machine learning (ML) lifecycle. It was developed by Databricks" ) }, )</LI-CODE> <P>You then use this example within <FONT face="courier new,courier">make_genai_metric()</FONT> which can be used like other metrics within <FONT face="courier new,courier">mlflow.evaluate():<BR /></FONT></P> </TD> </TR> </TBODY> </TABLE> <TABLE style="border-style: hidden; width: 100%;" border="1" width="100%"> <TBODY> <TR> <TD width="100%" height="842px"><LI-CODE lang="python">metric = make_genai_metric( name="answer_correctness", definition=( "Answer correctness is evaluated on the accuracy of the provided output based on " "the provided targets, which is the ground truth..." ), grading_prompt=( "Answer correctness: Below are the details for different scores:" "- Score 1: The output is completely incorrect. It is completely different from " "or contradicts the provided targets." "- Score 5: The output is correct. It demonstrates a high degree of accuracy and " "semantic similarity to the targets." ), examples=[example], version="v1", model="openai:/gpt-4", grading_context_columns=["targets"], parameters={"temperature": 0.0}, aggregations=["mean", "variance", "p90"], greater_is_better=True, ) </LI-CODE> <H1><STRONG><BR />Summary</STRONG></H1> <P><SPAN>Throughout this article, we've delved into how LLMOps focuses on the unique challenges of deploying, monitoring, and managing LLMs such as DBRX and Llama3.</SPAN></P> <P><SPAN>Our exploration covered the native support within MLflow for LLM evaluation and associated metrics so that we can better assess our LLMs’ performance. We discussed the use of default and custom function-based metrics, as well as advanced techniques like the LLM-as-a-judge approach for comprehensive model assessment. Databricks includes all of the tools needed for developing, deploying, and managing your large language models.&nbsp;</SPAN></P> </TD> </TR> </TBODY> </TABLE> <H1><SPAN>Coming up next!</SPAN></H1> <P><SPAN>Next blog in this series: MLOps Gym - IDE vs Notebooks for ML Workloads</SPAN></P> Thu, 13 Jun 2024 09:57:47 GMT Will_Smith 2024-06-13T09:57:47Z https://community.databricks.com/t5/technical-blog/mlops-gym-evaluating-large-language-models-with-mlflow/ba-p/72815 <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="image (9).png" style="width: 999px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8306iB557BF2D6CE4108B/image-size/large?v=v2&amp;px=999" role="button" title="image (9).png" alt="image (9).png" /></span></P> Thu, 13 Jun 2024 09:57:47 GMT https://community.databricks.com/t5/technical-blog/mlops-gym-evaluating-large-language-models-with-mlflow/ba-p/72815 Will_Smith 2024-06-13T09:57:47Z