AI safety testing
Editorial picks for "ai safety eval".
22 tools
Arize AI
Arize AX is an AI engineering platform for improving AI agents and applications.
Giskard
Continuous AI red teaming platform that detects vulnerabilities and safeguards AI agents.
OpenAI Evals
TruLens
Open source library for evaluating and tracing AI agents.
Patronus
Automated LLM evaluation for hallucinations, safety, and quality.
Inspect AI
Inspect is a framework for frontier AI evaluations developed by the UK AI Security Institute and Meridian Labs.
Promptfoo
Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.
Arthur
Arthur unites security, finance, and the teams shipping AI on one control plane for AI you can trust.
Fiddler AI
The AI Control Plane for enterprises providing visibility, context, and control through evaluation, monitoring, enforcement, governance, and cost efficiency.
Maxim AI
End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.
SEAL Leaderboard
Private, expert-graded leaderboards from Scale AI that rank frontier LLMs on domains contaminated public benchmarks can no longer measure.
VisualWebArena
Open benchmark for evaluating multimodal web agents on realistic visual browsing tasks.
Superwise
Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.
Guild AI
Guild is a neutral control plane for AI agents designed to work across all models and vendors.
Cleanlab TLM
Cleanlab TLM scores the trustworthiness of responses from any LLM in real-time.
Prediction Guard
Self-hosted AI control plane that lets regulated enterprises govern models, agents, and MCP servers behind their firewall.
Axtary
Content authorization for AI agents that checks the exact diff, message, query, or tool payload before a connector executes.
Cloud World Model
Simulate cloud infrastructure cost, latency, errors, and resilience across AWS, GCP, Azure, OCI, and DigitalOcean before deployment.
Lakera
An AI-native security platform designed to accelerate GenAI initiatives for enterprise teams.
LangWatch
Agent observability and evaluation platform for AI platform teams.
ModelBias
100 AI models, 100 simple questions, asked 3 times each, with 30,000 answers to explore.
ModelFuzz
ModelFuzz secures LLM agents against prompt injection by scanning for vulnerabilities and blocking unsafe tool calls at the execution layer.