> For the complete documentation index, see [llms.txt](https://docs.datasaur.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.datasaur.ai/llm-projects/evaluation/automated-evaluation/multi-application-evaluation.md).

# Multi-model evaluation

This feature allows you to compare and evaluate the performance of multiple models using various metrics from evaluators like Ragas, Langchain, and Deepeval.

## Get started

To evaluate multiple models:

1. Navigate to the **Evaluation** page from the sidebar.
2. Click the **Create evaluation project** button and choose **Automated evaluation** project type, then **Continue**.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-aebfa48377bb382a86cde19afd25715f0180d801%2FEvaluation%20-%20Create%20evaluation%20project%20dialog.png?alt=media" alt=""><figcaption></figcaption></figure>
3. Configure your evaluation by selecting the models to evaluate and choosing a dataset from the library. If you don’t have one, you can also upload a dataset in a CSV format containing two columns: `prompt` and `expected completion`.

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-995df2ed176b7c4839291945a99f1f2681e88b10%2FAutomated%20evaluation%20-%20PCW%20-%20Step%201.png?alt=media" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
If you can’t find your model in the list, go to the [Sandbox](/llm-projects/sandbox.md) where your model is created, and [deploy](/llm-projects/sandbox.md#deploy-models) or save to library. You can only evaluate deployed or saved models.
{% endhint %}

4. Select the metric, provider, and the evaluator model you want to use for evaluation. Learn more about the [evaluators and metrics](/llm-projects/evaluation/automated-evaluation.md#evaluators).

   <figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-395aa9074c5a5e7da924c38475b7d72a6bb85117%2FAutomated%20evaluation%20-%20PCW%20-%20Step%202.png?alt=media" alt=""><figcaption></figcaption></figure>
5. Click **Create evaluation** **project** and wait for the evaluation process to finish.

## Analyze the evaluation results

After the evaluation process is completed, you can analyze the results.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-67fc3b78e27b6a086863b3154a299d9d5e037fe0%2FAutomated%20evaluation%20-%20Project%20-%20Multiple%20applications.png?alt=media" alt=""><figcaption></figcaption></figure>

### Summary of the evaluation

Here you can view the total cost, time taken for generating completions, and the overall performance score given by the evaluator.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-f0328ba8c8f24a297fe67259b86e5d9e9ad6444d%2FAutomated%20evaluation%20-%20Project%20-%20Multiple%20applications%20-%20Summary.png?alt=media" alt=""><figcaption></figcaption></figure>

### Result and score from each model

Here you can view the quality, the score, and the processing time of the generated completions from each model.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-fb57e33301ce0a8bcd8fb5159d6220262948a283%2FAutomated%20evaluation%20-%20Project%20-%20Multiple%20applications%20-%20Result%20table.png?alt=media" alt=""><figcaption></figcaption></figure>

### Evaluation details

To view the evaluation details of a completion, click the three-dot menu at the far right of the row, then select **View details**.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-4dc415a138a4748e244f29d78a977fdfc81a662d%2FAutomated%20evaluation%20-%20Project%20-%20Multiple%20applications%20-%20Evaluation%20details%20dialog%20(1).png?alt=media" alt=""><figcaption></figcaption></figure>
