AI safety testing

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Continuous AI red teaming platform that stress-tests LLM agents for vulnerabilities before they hit production.

OpenAI's open-source framework for benchmarking LLMs against a shared registry of evaluations.

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Automated LLM evaluation for hallucinations, safety, and quality.

Open-source LLM evaluation framework from the UK AI Security Institute with 200+ built-in benchmarks.

Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.

Open-source toolkit for testing, tracing, and monitoring production AI agents.

Enterprise AI observability and guardrails platform for monitoring agents, LLMs, and ML models in production.

End-to-end evaluation, simulation, and observability platform for shipping production-grade AI agents.

Private, expert-graded leaderboards from Scale AI that rank frontier LLMs on domains contaminated public benchmarks can no longer measure.

Open benchmark for evaluating multimodal web agents on realistic visual browsing tasks.

Agentic management platform for runtime guardrails, policy enforcement, and observability across LLM agents.

Control plane for deploying, governing, and auditing AI agents in production.

Trustworthiness scoring layer that flags LLM hallucinations in real time.

Self-hosted AI control plane that lets regulated enterprises govern models, agents, and MCP servers behind their firewall.

Content authorization and payload-binding for AI agents

Simulate AWS, GCP, Azure, OCI, and DigitalOcean infrastructure without provisioning real resources.

Runtime security and guardrails for GenAI apps, agents, and RAG systems.

Simulation-based testing, evaluation, and observability for LLM agents

100 models, 100 prompts, 30,000 answers — an interactive look at AI defaults

Open-source red-teaming and execution-layer defense for AI agents against prompt injection.