LLM observability

Eval, monitor, and improve AI products end-to-end.

LangChain's eval + observability platform.

The ML experiment tracker, now with LLM eval features.

Open-source LLM observability — one-line proxy install.

Observability and debugging platform purpose-built for AI agents, with time-travel replay and cost tracking across 400+ LLMs.

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Continuous AI red teaming platform that stress-tests LLM agents for vulnerabilities before they hit production.

Prompt management + evals for collaborative AI teams.

Collaborative LLM evaluation and observability platform for teams shipping AI features to production.

OpenTelemetry-native observability and evaluation platform for LLM agents in production.

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

OpenAI's open-source framework for benchmarking LLMs against a shared registry of evaluations.

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.

Git-style prompt management, testing, and deployment platform for teams running multiple LLMs in production.

Lightweight prompt logging + management for OpenAI/Claude apps.

Automated LLM evaluation for hallucinations, safety, and quality.

Enterprise API gateway extended to route, govern, and observe LLM and agent traffic across providers.

Open-source LLM observability, prompt management, and evaluation in one platform.

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Kubernetes-native MLOps platform for deploying and orchestrating ML and generative AI models in production.

Open-source LLM evaluation framework from the UK AI Security Institute with 200+ built-in benchmarks.

Envoy-based data plane for AI agents that handles routing, guardrails, and observability outside your app code.

Open-source AI gateway that routes a single API call across 1,600+ LLMs with caching, fallbacks, and observability.

Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.

Production AI inference platform for deploying and monitoring models across cloud, on-prem, and edge.

Open-source toolkit for testing, tracing, and monitoring production AI agents.

Enterprise AI observability and guardrails platform for monitoring agents, LLMs, and ML models in production.

End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.

Production LLM gateway with observability, guardrails, and prompt management for teams shipping AI in anger.

Git-native prompt management and observability platform for teams shipping LLM applications.

LLM engineering platform combining a multi-model gateway with tracing, evals, and prompt management.

Open-source LLM and agent observability platform with tracing, evals, and experimentation built on OpenTelemetry.

Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.

Self-hosted AI governance gateway that audits, gates, and logs every LLM call before it leaves your network.

Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.

Control plane for deploying, governing, and auditing AI agents in production.

Enterprise control plane for deploying, governing, and scaling agentic AI on your own infrastructure.

Trustworthiness scoring layer that flags LLM hallucinations in real time.

LLM evaluation, observability, and prompt management platform for teams shipping production AI apps.

Local usage meter that turns AI coding-agent tokens into estimated electricity and water consumption.

The open-source columnar database powering real-time analytics — and, increasingly, LLM observability and RAG backends.

Self-hosted generative engine optimization for tracking brand mentions across ChatGPT, Perplexity, and Gemini

Local-first trust control plane that routes AI tasks to the cheapest model that clears your confidence bar.

Measure the gap between what your site claims and what an AI agent actually finds

Runtime security and guardrails for GenAI apps, agents, and RAG systems.

Simulation-based testing, evaluation, and observability for LLM agents

Token-level citation and attribution API for AI-generated answers