All AI tools
59 tools
LLMEval
Research initiative from Fudan NLP Lab building evaluation frameworks for LLMs across academic disciplines and medical AI.
Promptfoo
Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.
Weco AI
Weco AI optimizes code against measurable metrics such as speed, accuracy, and cost.
AlpacaEval
Automatic LLM evaluator and leaderboard that benchmarks instruction-following with length-controlled win rates.
Arthur
Arthur unites security, finance, and the teams shipping AI on one control plane for AI you can trust.
Fiddler AI
The AI Control Plane for enterprises providing visibility, context, and control through evaluation, monitoring, enforcement, governance, and cost efficiency.
Maxim AI
End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.
Prompt Foundry
Prompt management and side-by-side LLM evaluation for OpenAI and Anthropic models.
Respan (formerly Keywords AI)
The AI router with built-in observability and automated evals.
SEAL Leaderboard
Private, expert-graded leaderboards from Scale AI that rank frontier LLMs on domains contaminated public benchmarks can no longer measure.
VisualWebArena
Open benchmark for evaluating multimodal web agents on realistic visual browsing tasks.
LangFast
No-signup LLM playground for testing, comparing, and versioning prompts against your own API keys.
llmfit
A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU.
OlympicArena
Phoenix
Open-source AI observability and evaluation platform for tracing and improving AI agents.
Superwise
Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.
Agenta
Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.
CompassRank
Public leaderboard from the OpenCompass project ranking open and closed LLMs across 100+ benchmarks.
InfiBench
MixEval
Arena AI
Head-to-head LLM battle arena with a public leaderboard for ranking AI models.
Artificial Analysis
Independent benchmarking platform comparing AI models and inference providers across intelligence, speed, and cost.
Cleanlab TLM
Cleanlab TLM scores the trustworthiness of responses from any LLM in real-time.
Parea AI
LLM evaluation, observability, and prompt management platform for teams shipping production AI apps.