MathEval alternatives
2 mutual alternatives and 4 other related tools for MathEval, ordered by editorial similarity. See all tools on the alternatives hub.
Mutual alternatives (both tools list each other)
LL
LLMEval
Evaluation · Multi-model
7.2
Research initiative from Fudan NLP Lab building evaluation frameworks for LLMs across academic disciplines and medical AI.
FreeLLM evaluationEvaluation methodology research
MI
MixEval
Evaluation · GPT-3.5-Turbo-0125, GPT-4o-2024-05-13, Claude 3.5 Sonnet, MixEval, MixEval-Hard
6.9
FreeModel rankingEvaluating various model sizes
Also related
MathEval lists these as alternatives, but they do not list MathEval back.
OE
OpenAI Evals
Evaluation · OpenAI GPT models (extensible)
8.1
FreeEvaluating LLMs and LLM systemsTesting different dimensions of OpenAI models
AL
AlpacaEval
Evaluation · GPT-4 Preview (Nov 2024) as annotator
7.1
Automatic LLM evaluator and leaderboard that benchmarks instruction-following with length-controlled win rates.
Free· Free and open-source; pay only for the underlying OpenAI annotator API callsllm-benchmarkinginstruction-following eval
LI
LiveBench
Evaluation · Multi-model
8.2
Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.
Free· Free and open source; self-hosted evaluation runnerllm-benchmarkingmodel-selection
IA
Inspect AI
Evaluation · Multi-model
7.2
Inspect is a framework for frontier AI evaluations developed by the UK AI Security Institute and Meridian Labs.
Free· Free and open source (MIT-style license); you pay only for underlying model API usage.Coding and reasoning evaluationAgent evaluation