Last updated
In Datasaur, we support three types of evaluation. You can choose the one that best suits your needs.
Evaluate a model or pre-generated completions automatically using your preferred metrics by comparing them to a ground truth.
Evaluate your model manually by ranking several completion results from each prompt from best to worst. You can evaluate pre-generated completions or a model and determine how many results it needs to generate.
Evaluate each completion result from each prompt by rating them with 1 to 5 stars and providing your expected completions. You can evaluate pre-generated completions or a model.
Last updated