Best AI tools for safety testing
19 tools in the Evaluation category, filtered to safety testing.
Arize AI
Arize AX is an AI engineering platform for improving AI agents and applications.
Giskard
Continuous AI red teaming platform that detects vulnerabilities and safeguards AI agents.
OpenAI Evals
TruLens
Open source library for evaluating and tracing AI agents.
Patronus
Automated LLM evaluation for hallucinations, safety, and quality.
Inspect AI
Inspect is a framework for frontier AI evaluations developed by the UK AI Security Institute and Meridian Labs.
LLMEval
Research initiative from Fudan NLP Lab building evaluation frameworks for LLMs across academic disciplines and medical AI.
Promptfoo
Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.
Arthur
Arthur unites security, finance, and the teams shipping AI on one control plane for AI you can trust.
Fiddler AI
The AI Control Plane for enterprises providing visibility, context, and control through evaluation, monitoring, enforcement, governance, and cost efficiency.
Maxim AI
End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.
SEAL Leaderboard
Private, expert-graded leaderboards from Scale AI that rank frontier LLMs on domains contaminated public benchmarks can no longer measure.
VisualWebArena
Open benchmark for evaluating multimodal web agents on realistic visual browsing tasks.
OlympicArena
Superwise
Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.
Cleanlab TLM
Cleanlab TLM scores the trustworthiness of responses from any LLM in real-time.
Lakera
An AI-native security platform designed to accelerate GenAI initiatives for enterprise teams.
ModelBias
100 AI models, 100 simple questions, asked 3 times each, with 30,000 answers to explore.
ModelFuzz
ModelFuzz secures LLM agents against prompt injection by scanning for vulnerabilities and blocking unsafe tool calls at the execution layer.