LLM monitoring

Eval, monitor, and improve AI products end-to-end.

LangChain's eval + observability platform.

The ML experiment tracker, now with LLM eval features.

Open-source LLM observability — one-line proxy install.

Observability and debugging platform purpose-built for AI agents, with time-travel replay and cost tracking across 400+ LLMs.

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Collaborative LLM evaluation and observability platform for teams shipping AI features to production.

OpenTelemetry-native observability and evaluation platform for LLM agents in production.

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.

Lightweight prompt logging + management for OpenAI/Claude apps.

Enterprise API gateway extended to route, govern, and observe LLM and agent traffic across providers.

Open-source LLM observability, prompt management, and evaluation in one platform.

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Envoy-based data plane for AI agents that handles routing, guardrails, and observability outside your app code.

Open-source AI gateway that routes a single API call across 1,600+ LLMs with caching, fallbacks, and observability.

Production AI inference platform for deploying and monitoring models across cloud, on-prem, and edge.

Open-source toolkit for testing, tracing, and monitoring production AI agents.

Enterprise AI observability and guardrails platform for monitoring agents, LLMs, and ML models in production.

End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.

Production LLM gateway with observability, guardrails, and prompt management for teams shipping AI in anger.

Git-native prompt management and observability platform for teams shipping LLM applications.

LLM engineering platform combining a multi-model gateway with tracing, evals, and prompt management.

Open-source LLM and agent observability platform with tracing, evals, and experimentation built on OpenTelemetry.

Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.

Self-hosted AI governance gateway that audits, gates, and logs every LLM call before it leaves your network.

Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.

Control plane for deploying, governing, and auditing AI agents in production.

Trustworthiness scoring layer that flags LLM hallucinations in real time.

LLM evaluation, observability, and prompt management platform for teams shipping production AI apps.

Local usage meter that turns AI coding-agent tokens into estimated electricity and water consumption.

The open-source columnar database powering real-time analytics — and, increasingly, LLM observability and RAG backends.

Official Grafana Labs MCP server — dashboards, Prometheus, Loki, alerts and incidents in your LLM client

Self-hosted generative engine optimization for tracking brand mentions across ChatGPT, Perplexity, and Gemini

Measure the gap between what your site claims and what an AI agent actually finds

Runtime security and guardrails for GenAI apps, agents, and RAG systems.

Simulation-based testing, evaluation, and observability for LLM agents