AI tools tagged On Premise

LiveBench

Evaluation · Multi-model

8.2

Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.

OpenBB

Agents · Multi-model (Agent Rita is model-agnostic)

7.3

Open-source financial workspace where analysts and AI agents share the same governed data.

Neu.ro

Agents · Multi-model

7.1

Infrastructure-agnostic MLOps platform for the full ML/DL lifecycle across public, hybrid, and on-prem clouds.

PrivateGPT

RAG · Multi-model (BYO local LLM)

7.0

Production-ready, air-gapped RAG framework for querying your documents with local LLMs.

Katonic AI

Agents · Multi-model (2,600+ via AI Gateway)

6.9

Sovereign enterprise platform for building, deploying, and governing AI agents on your own infrastructure.

Context Data

RAG · Multi-model

6.8

Enterprise data platform for deploying private RAG pipelines without infrastructure plumbing.

Prediction Guard

Agents · Multi-model

6.6

Self-hosted AI control plane that lets regulated enterprises govern models, agents, and MCP servers behind their firewall.

BatchEdits

Video

Bulk AI video editor that processes up to 50 clips in parallel

CoreBase

Agents · Bring-your-own-key: Claude, GPT-4/4o, Gemini (plus built-in fallback models)

Governed AI-agent infrastructure that safely connects LLMs to your real data systems

E2B

Agents · LLM-agnostic (works with GPT-4o, Claude, Mistral, Llama, and self-hosted models)

Secure cloud sandboxes for running AI-generated code

Netdata

Agents · In-house unsupervised ML models for per-metric anomaly detection; AI Co-Engineer and Ask Nedi built on third-party LLMs (unspecified) with MCP integration for external assistants

Real-time infrastructure observability with embedded AI anomaly detection and an AI co-engineer for root-cause analysis.

Vectara

RAG · In-house Boomerang (retrieval) and Mockingbird (generation) plus BYOM for GPT, Claude, Gemini, and open-weight LLMs

Enterprise agent platform with built-in retrieval, grounding, and hallucination controls