AI prompt evaluation
Editorial picks for "prompt evaluation tool".
48 tools
Braintrust
FeaturedBraintrust is an AI observability platform for tracing production, running evals, and catching regressions before they reach users.
LangSmith
LangChain's eval + observability platform.
Weights & Biases
The ML experiment tracker, now with LLM eval features.
Arize AI
Arize AX is an AI engineering platform for improving AI agents and applications.
Giskard
Continuous AI red teaming platform that detects vulnerabilities and safeguards AI agents.
Humanloop
Prompt management + evals for collaborative AI teams.
LiveBench
Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.
OpenAI Playground
OpenAI's official browser sandbox for prompting, tuning, and testing every model on the platform before you ship API code.
Athina AI
Collaborative LLM evaluation and observability platform for teams shipping AI features to production.
Berkeley Function-Calling Leaderboard
Open benchmark from UC Berkeley that ranks LLMs on real-world tool-use and function-calling accuracy.
HoneyHive
OpenTelemetry-native observability and evaluation platform for LLM agents in production.
MLflow
Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.
OpenAI Evals
TruLens
Open source library for evaluating and tracing AI agents.
W&B Weave
Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.
PromptHub
A community-driven platform for discovering, managing, versioning, testing, and deploying prompts.
Rivet
Visual programming environment for building AI agents with LLMs.
LLM Stats
PromptLayer
Prompt management platform for AI teams to version prompts, run LLM evals, and monitor agents in production.
Patronus
Automated LLM evaluation for hallucinations, safety, and quality.
Langfuse
Open-source AI engineering platform for building, monitoring, and improving LLM applications.
Opik
End-to-end AI observability platform for testing, shipping, and improving agentic systems.
Inspect AI
Inspect is a framework for frontier AI evaluations developed by the UK AI Security Institute and Meridian Labs.
Kiln AI
Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.
Promptfoo
Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.
Weco AI
Weco AI optimizes code against measurable metrics such as speed, accuracy, and cost.
AlpacaEval
Automatic LLM evaluator and leaderboard that benchmarks instruction-following with length-controlled win rates.
Maxim AI
End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.
Prompt Foundry
Prompt management and side-by-side LLM evaluation for OpenAI and Anthropic models.
Puzzlet AI
Git-native prompt management and observability platform for teams shipping LLM applications.
Respan (formerly Keywords AI)
The AI router with built-in observability and automated evals.
SEAL Leaderboard
Private, expert-graded leaderboards from Scale AI that rank frontier LLMs on domains contaminated public benchmarks can no longer measure.
VisualWebArena
Open benchmark for evaluating multimodal web agents on realistic visual browsing tasks.
LangFast
No-signup LLM playground for testing, comparing, and versioning prompts against your own API keys.
Phoenix
Open-source AI observability and evaluation platform for tracing and improving AI agents.
Prompteams
Prompteams manages AI prompts, provides a playground and LLM testing, and offers version control and auto-generated APIs for team integration.
Agenta
Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.
CompassRank
Public leaderboard from the OpenCompass project ranking open and closed LLMs across 100+ benchmarks.
Izlo
Izlo provides prompt control for teams to unlock prompts trapped in code, documents, and spreadsheets.
MixEval
Arena AI
Head-to-head LLM battle arena with a public leaderboard for ranking AI models.
Parea AI
LLM evaluation, observability, and prompt management platform for teams shipping production AI apps.
PromptPerfect
Prompt optimizer from Jina AI that rewrites and stress-tests prompts across major LLMs.
Magic Potion
Visual drag-and-drop prompt editor for crafting, organizing, and reusing prompts across OpenAI, Anthropic, and Google models.
AI World Bakeoff
Ten AI coding models build three identical explorable 3D worlds in a single autonomous shot.
Lagotto Meter
Measure the gap between what your site claims and what an AI agent actually finds
LangWatch
Agent observability and evaluation platform for AI platform teams.
ModelBias
100 AI models, 100 simple questions, asked 3 times each, with 30,000 answers to explore.