AI prompt evaluation

Eval, monitor, and improve AI products end-to-end.

LangChain's eval + observability platform.

The ML experiment tracker, now with LLM eval features.

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Continuous AI red teaming platform that stress-tests LLM agents for vulnerabilities before they hit production.

Prompt management + evals for collaborative AI teams.

Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.

OpenAI's official browser sandbox for prompting, tuning, and testing every model on the platform before you ship API code.

Collaborative LLM evaluation and observability platform for teams shipping AI features to production.

Open benchmark from UC Berkeley that ranks LLMs on real-world tool-use and function-calling accuracy.

OpenTelemetry-native observability and evaluation platform for LLM agents in production.

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

OpenAI's open-source framework for benchmarking LLMs against a shared registry of evaluations.

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.

Git-style prompt management, testing, and deployment platform for teams running multiple LLMs in production.

Open-source visual IDE for building and debugging LLM agent graphs.

Live leaderboard and side-by-side comparison hub for 300+ frontier LLMs across reasoning, coding, and multimodal benchmarks.

Lightweight prompt logging + management for OpenAI/Claude apps.

Automated LLM evaluation for hallucinations, safety, and quality.

Open-source LLM observability, prompt management, and evaluation in one platform.

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Open-source LLM evaluation framework from the UK AI Security Institute with 200+ built-in benchmarks.

Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.

Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.

Autoresearch engine that iteratively rewrites code to optimize against a numeric evaluation metric.

Automatic LLM evaluator and leaderboard that benchmarks instruction-following with length-controlled win rates.

End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.

Prompt management and side-by-side LLM evaluation for OpenAI and Anthropic models.

Git-native prompt management and observability platform for teams shipping LLM applications.

LLM engineering platform combining a multi-model gateway with tracing, evals, and prompt management.

Private, expert-graded leaderboards from Scale AI that rank frontier LLMs on domains contaminated public benchmarks can no longer measure.

Open benchmark for evaluating multimodal web agents on realistic visual browsing tasks.

No-signup LLM playground for testing, comparing, and versioning prompts against your own API keys.

Open-source LLM and agent observability platform with tracing, evals, and experimentation built on OpenTelemetry.

Git-style version control and testing for LLM prompts, with auto-generated APIs that ship updates without redeploys.

Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.

Public leaderboard from the OpenCompass project ranking open and closed LLMs across 100+ benchmarks.

Prompt management platform with version control, collaboration, and an API for production deployment.

Dynamic LLM benchmark that mixes web queries with existing datasets to mirror Chatbot Arena rankings at a fraction of the cost.

Head-to-head LLM battle arena with a public leaderboard for ranking AI models.

LLM evaluation, observability, and prompt management platform for teams shipping production AI apps.

Prompt optimizer from Jina AI that rewrites and stress-tests prompts across major LLMs.

Visual drag-and-drop prompt editor for crafting, organizing, and reusing prompts across OpenAI, Anthropic, and Google models.

Ten AI coding models, three identical briefs, thirty explorable 3D worlds

Measure the gap between what your site claims and what an AI agent actually finds

Simulation-based testing, evaluation, and observability for LLM agents

100 models, 100 prompts, 30,000 answers — an interactive look at AI defaults