Best AI tools for monitoring

Eval, monitor, and improve AI products end-to-end.

LangChain's eval + observability platform.

The ML experiment tracker, now with LLM eval features.

Open-source LLM observability — one-line proxy install.

Observability and debugging platform purpose-built for AI agents, with time-travel replay and cost tracking across 400+ LLMs.

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Open-source data quality framework for validating the datasets that feed your ML and analytics pipelines.

Collaborative LLM evaluation and observability platform for teams shipping AI features to production.

OpenTelemetry-native observability and evaluation platform for LLM agents in production.

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.

Open-source LLM observability, prompt management, and evaluation in one platform.

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Open-source toolkit for testing, tracing, and monitoring production AI agents.

Enterprise AI observability and guardrails platform for monitoring agents, LLMs, and ML models in production.

End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.

LLM engineering platform combining a multi-model gateway with tracing, evals, and prompt management.

Open-source LLM and agent observability platform with tracing, evals, and experimentation built on OpenTelemetry.

Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.

Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.

Independent benchmarking platform comparing AI models and inference providers across intelligence, speed, and cost.

Trustworthiness scoring layer that flags LLM hallucinations in real time.

LLM evaluation, observability, and prompt management platform for teams shipping production AI apps.

Local usage meter that turns AI coding-agent tokens into estimated electricity and water consumption.

The open-source columnar database powering real-time analytics — and, increasingly, LLM observability and RAG backends.

Self-hosted generative engine optimization for tracking brand mentions across ChatGPT, Perplexity, and Gemini

Measure the gap between what your site claims and what an AI agent actually finds

Runtime security and guardrails for GenAI apps, agents, and RAG systems.

Simulation-based testing, evaluation, and observability for LLM agents

Visualizer for neural network, deep learning, and machine learning models

Physics-based calculator that predicts LLM decode speed, memory fit, and quantization quality on any hardware.