LLM observability

Helicone

Evaluation · Platform (any LLM)

8.3

Open-source LLM observability — one-line proxy install.

Arize AI

Evaluation · Multi-model

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Athina AI

Evaluation · Multi-model

Collaborative LLM evaluation and observability platform for teams shipping AI features to production.

Fiddler AI

Evaluation · Fiddler Centor (proprietary evaluators)

Enterprise AI observability and guardrails platform for monitoring agents, LLMs, and ML models in production.

Langfuse

Evaluation · Model-agnostic

Open-source LLM observability, prompt management, and evaluation in one platform.

Maxim AI

Evaluation · Multi-model

End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.

Opik

Evaluation · Multi-model

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Puzzlet AI

Agents · Multi-model

Git-native prompt management and observability platform for teams shipping LLM applications.

Respan (formerly Keywords AI)

Evaluation · Multi-model (500+ via gateway)

LLM engineering platform combining a multi-model gateway with tracing, evals, and prompt management.