All AI tools
59 tools
Braintrust
FeaturedBraintrust is an AI observability platform for tracing production, running evals, and catching regressions before they reach users.
LangSmith
LangChain's eval + observability platform.
Weights & Biases
The ML experiment tracker, now with LLM eval features.
Helicone
AI Gateway and LLM Observability platform
Arize AI
Arize AX is an AI engineering platform for improving AI agents and applications.
Giskard
Continuous AI red teaming platform that detects vulnerabilities and safeguards AI agents.
Great Expectations
Open source framework for testing, validating, and documenting data quality across modern data pipelines, workflows, and teams.
Humanloop
Prompt management + evals for collaborative AI teams.
LiveBench
Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.
Athina AI
Collaborative LLM evaluation and observability platform for teams shipping AI features to production.
Berkeley Function-Calling Leaderboard
Open benchmark from UC Berkeley that ranks LLMs on real-world tool-use and function-calling accuracy.
HoneyHive
OpenTelemetry-native observability and evaluation platform for LLM agents in production.
MLflow
Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.
OpenAI Evals
TruLens
Open source library for evaluating and tracing AI agents.
W&B Weave
Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.
LLM Stats
PromptLayer
Prompt management platform for AI teams to version prompts, run LLM evals, and monitor agents in production.
Patronus
Automated LLM evaluation for hallucinations, safety, and quality.
Langfuse
Open-source AI engineering platform for building, monitoring, and improving LLM applications.
MathEval
Opik
End-to-end AI observability platform for testing, shipping, and improving agentic systems.
Inspect AI
Inspect is a framework for frontier AI evaluations developed by the UK AI Security Institute and Meridian Labs.
Kiln AI
Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.