EvalPlus

Linux · Self-hosted · API

Visit site Alternatives

Freedom report

One barScore 5.3

Free tierNo free tier on record
Open codeNo open-source code on record
Runs widely1 of 6 device platforms
DocumentedPlans, terms and facts published

EvalPlus is ranked #17 of 29 in LLM evaluation tools on Freedom251. It runs on API, Linux, Self-hosted.

Compared on LLM evaluation tools

Deployment options: self-hosted

Best EvalPlus alternatives

See all 20

Two bars DeepEval Free tier No. 1Free6.6 Two bars Promptfoo Free tier No. 2Free6.6 One bar Giskard Free tier No. 3Free6.5 One bar Braintrust Free tier No. 4$249/mo6.4 One bar Confident AI Free tier No. 5$200/mo6.4 One bar Galileo Free tier No. 6$100/mo6.4

The record

Purpose: EvalPlus is an evaluation framework for assessing code generated by large language models.
HumanEval+: HumanEval+ expands the original HumanEval benchmark with 80 times more tests.
MBPP+: MBPP+ expands the original MBPP benchmark with 35 times more tests.
Efficiency evaluation: EvalPerf evaluates the efficiency of LLM-generated code using performance-exercising tasks and test inputs.
Leaderboard: The EvalPlus site provides leaderboards for HumanEval+ and MBPP+ evaluation results.
EvalPerf leaderboard: The EvalPlus site provides a leaderboard for EvalPerf code efficiency results.
RepoQA: The EvalPlus site describes RepoQA as a project to design evaluators for long-context code understanding.
Installation: The README documents installation through pip, including optional vLLM and performance extras.
Docker: The README documents running code evaluation in Docker.
Model backends: Documented backends include Hugging Face Transformers, vLLM, OpenAI-compatible servers, OpenAI, Anthropic, Google, Amazon Bedrock, Ollama, and Intel Gaudi.
Security: The README describes Docker-based code execution as safe code execution.
Platform limit: The README labels EvalPerf code efficiency evaluation as *nix only.
License: The repository is distributed under the Apache License, Version 2.0; the license notes that files under evalplus/eval additionally comply with the MIT License.
Intended audience: The project is intended for evaluating LLM performance on code-related tasks.

Where it ranks on Freedom251

Best LLM Evaluation Tools in 2026#17 of 29

Is EvalPlus yours?

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.

Claim it free Promote EvalPlus

Sources

github.com/evalplus/evalplus· checked 5 Oct 2026
evalplus.github.io· checked 5 Oct 2026
github.com/evalplus/evalplus/blob/master/LICENSE· checked 5 Oct 2026