Evaluation
Observability, prompt testing, and quality scoring.
59 tools
Evaluation is the discipline most underinvested in by AI product teams. Choosing an eval tool early is much cheaper than retrofitting one when an LLM regression hits production.
Spans full eval + observability platforms (Braintrust, LangSmith), prompt management (Humanloop, PromptLayer), ML-broad tracking with LLM features (Weights & Biases), and proxy-based observability (Helicone).
Pick Braintrust or LangSmith for full eval + observability. Pick Humanloop if PMs need to edit prompts. Pick Helicone for a one-line install on existing OpenAI/Claude code. Pick Patronus for automated hallucination/safety evals at scale.
Browse Evaluation by subcategory
Popular use cases
Alternatives to the leaders
Leaders are the highest-scoring tools in this category on our AI-assisted editorial rubric.
Braintrust
FeaturedBraintrust is an AI observability platform for tracing production, running evals, and catching regressions before they reach users.
LangSmith
LangChain's eval + observability platform.
Weights & Biases
The ML experiment tracker, now with LLM eval features.
Helicone
AI Gateway and LLM Observability platform
Arize AI
Arize AX is an AI engineering platform for improving AI agents and applications.
Giskard
Continuous AI red teaming platform that detects vulnerabilities and safeguards AI agents.
Great Expectations
Open source framework for testing, validating, and documenting data quality across modern data pipelines, workflows, and teams.
Humanloop
Prompt management + evals for collaborative AI teams.
LiveBench
Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.
Athina AI
Collaborative LLM evaluation and observability platform for teams shipping AI features to production.
Berkeley Function-Calling Leaderboard
Open benchmark from UC Berkeley that ranks LLMs on real-world tool-use and function-calling accuracy.
HoneyHive
OpenTelemetry-native observability and evaluation platform for LLM agents in production.
MLflow
Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.
OpenAI Evals
TruLens
Open source library for evaluating and tracing AI agents.
W&B Weave
Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.
LLM Stats
PromptLayer
Prompt management platform for AI teams to version prompts, run LLM evals, and monitor agents in production.
Patronus
Automated LLM evaluation for hallucinations, safety, and quality.
Langfuse
Open-source AI engineering platform for building, monitoring, and improving LLM applications.
MathEval
Opik
End-to-end AI observability platform for testing, shipping, and improving agentic systems.
Inspect AI
Inspect is a framework for frontier AI evaluations developed by the UK AI Security Institute and Meridian Labs.
Kiln AI
Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.