Skip to main content
📖 The AI Tool Bible

AI tools tagged On Premise

48 tools matching this tag.tech

All tags →
SD

Stable Diffusion

Image Generation · SD 3.5 / SDXL
8.8

Enterprise-ready creative partner delivering professional-grade generative AI tools for content production at scale.

FreeMarketing asset creationGame and film sound design
EV

Elasticsearch Vector Search

RAG · BYO embeddings (OpenAI, Cohere, Hugging Face, Mistral, Bedrock, Vertex, Azure) plus Elastic's built-in ELSER sparse model and E5 dense model
8.7

Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine

Freemium· Resource based pricing: Pay as you go (monthly) or prepaid · Usage based pricing: Pay as you go (monthly) or prepaid · License based pricing: ?RAG chatbot over enterprise docsHybrid semantic + keyword product search
IW

IBM watsonx

Agents · IBM Granite (3.x, Code, Time Series), Meta Llama 3.x, Mistral, plus other curated open models
8.6

Portfolio of AI products for building AI applications, managing trusted data, and governing AI.

EnterpriseManaging and integrating trusted dataAutomating AI governance and regulatory compliance
PA

Palantir AIP

Agents · Multi-model (GPT, Claude, Llama, customer-hosted)
8.4

Enterprise AI platform that grounds LLMs in your operational data and runs agents against real business systems.

Enterprise· Contact sales; typically bundled with Foundryenterprise-agentsoperational-ai
LL

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1
8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Freemiumself-hosted-llmfine-tuning
VL

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
VE

Vespa

RAG · Hosted search engine (not an LLM)
8.2

Yahoo's open-source search engine with vector + sparse retrieval.

Freemium· Free open-source; Vespa Cloud paidlarge-scale searchranking
LA

Lambda

Fine-tuning · NVIDIA VR200 NVL72, NVIDIA GB300 NVL72, NVIDIA HGX B200, NVIDIA HGX B300, NVIDIA H100
8.1

Supercomputers for training and inference

Paid· NVIDIA HGX B200 1-Click Cluster (16 GPUs, 2 weeks – 1 year) is $9.86 per GPU per hour; NVIDIA H100 1-Click Cluster (16 GPUs, 2 weeks – 1 year) is $6.16 per GPU per hour; NVIDIA HGX B200 Instance (8x, 180 GB VRAM) is $7.69 per GPU per hour; NVIDIA HGX H100 Instance (8x, 80 GB VRAM) is $4.59 per GPU per hour; NVIDIA HGX A100 Instance (8x, 80 GB VRAM) is $3.19 per GPU per hour; NVIDIA HGX A100 Instance (8x, 40 GB VRAM) is $1.99 per GPU per hour; NVIDIA Tesla V100 Instance (8x, 16 GB VRAM) is $0.79 per GPU per hourTraining and inferenceTraining foundation models
LO

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)
8.1

LocalAI runs open models on the user's own hardware.

FreeChatting with open models on local hardwareRunning Python scripts on data files
CO

Continue

Coding · BYO (any OpenAI-compatible API + Ollama for local)
7.9

Open-source, self-hostable VS Code/JetBrains AI assistant.

Free· Free / open-source; you pay model costsself-hostedopen source
DA

DataRobot

Agents · Multi-model
7.8

Unified Agent Workforce Platform for Enterprise

EnterpriseAgentic AIPredictive AI
LA

Lamini

Fine-tuning · Lamini (built on open base models)
7.7

Memory-tuning platform for grounding LLMs in your facts.

Paid· Enterprise / contact salesenterprise FTfactual recall
MO

Modzy

Agents · Multi-model
7.7

Enterprise ModelOps platform for deploying and running AI/ML models across cloud, on-prem, and edge.

Enterprisemodel-deploymentedge-ai
TA

Tabnine

Coding · Proprietary (Tabnine-trained, on-prem capable)
7.6

Privacy-focused AI autocomplete with on-prem options.

Paid· Tabnine Code Assistant: $39 · Tabnine Agentic Platform: $59enterpriseprivacy
KA

Kong AI Gateway

Agents · Multi-model
7.3

Kong AI Gateway governs LLM, MCP, and agent-to-agent traffic with a single gateway.

Paid· Plus plan from $25/month plus usage, billed monthlyLLM, MCP, and A2A traffic governancePII sanitization and data leakage prevention
KU

Kubeflow

Agents · Multi-framework (PyTorch, JAX, XGBoost, TensorFlow)
7.3

Kubeflow is the Cloud Native AI platform.

Freemachine learning workflowsLLM fine-tuning
PA

Pachyderm

Fine-tuning
7.3

Kubernetes-native data versioning and pipeline engine for reproducible ML at petabyte scale.

Freemiumdata-versioningml-pipelines
SE

Seldon

Agents · Multi-model (bring your own)
7.3

Kubernetes-native MLOps framework for real-time inference, observability, and compliance at scale.

Freemiumreal-time inferenceA/B testing and canary deployments
DD

Domino Data Lab

Agents · Multi-model
7.2

Enterprise AI platform for building, scaling, and governing AI-powered applications.

EnterpriseBuilding AI systems and applicationsClinical trial submissions
SV

SAS Viya

Agents · Multi-model
7.2

SAS Viya unifies data, analytics and governance in one platform to deliver transparent and trustworthy insights at scale.

EnterpriseCustomer intelligence and fraud detectionHealth care and forecasting
WA

Wallaroo.AI

Agents · Multi-model
7.2

Production AI inference platform for deploying and monitoring models across cloud, on-prem, and edge.

Enterprise· Starter: $500 · Wallaroo Community Edition: Free · Ampere Community Edition: Freemodel-deploymentmlops
FA

Fiddler AI

Evaluation · Fiddler Centor (proprietary evaluators)
7.1

The AI Control Plane for enterprises providing visibility, context, and control through evaluation, monitoring, enforcement, governance, and cost efficiency.

Enterprise· Free plan; Developer plan at $0.002 per traceMonitoring and evaluationsHallucination and toxicity protection
IG

Iguazio

Agents · Multi-model
7.1

Enterprise MLOps and GenAI platform for taking models from notebook to production at scale.

Enterprise· Contact sales; free trial availablemlopsllm-fine-tuning
II

iii

Agents · Bring-your-own
7.1

Connect any functions, agents, APIs, models, browsers, infrastructure, and machines into one live, composable system.

FreeBuilding backends from functionsBuilding agents around workflows
NR

Neu.ro

Agents · Multi-model
7.1

Infrastructure-agnostic MLOps platform for the full ML/DL lifecycle across public, hybrid, and on-prem clouds.

Enterprise· Contact sales; no public pricingmlopsmodel-training
PO

PostgresML

RAG · Multi-model (Llama, Mistral, open-source embeddings)
7.1

PostgresML is a Postgres extension that combines data storage and machine learning inference within the database.

Freemium· Serverless: From $7.50 per query hour; Dedicated: From $0.60 per instance hourRetrieval-Augmented GenerationVector search
SG

Scale GenAI Platform

Fine-tuning · Multi-model (OpenAI, Google, Meta, Mistral)
7.1

Scale GenAI Platform provides tools to build, deploy, and improve agents that reason over enterprise data and scale reliably.

Enterprise· Contact sales; enterprise contracts onlyMulti-agent workflowsHuman feedback loops
TI

Tiledesk

Agents · Multi-model
7.1

Open-source, no-code platform for building AI chatbots and connecting live agents.

Freemium· Pro plan at €149 per month; Business plan at €499 per monthCustomer service and semantic searchAppointment scheduling
BI

Bisheng

Agents · Multi-model
7.0

Open-source enterprise AgentOps platform for building, orchestrating, and governing LLM agents at scale.

Freemium· Open-source community edition free; commercial enterprise edition via DataElement salesagent-orchestrationrag
KO

Kotaemon

RAG · Multi-model (OpenAI, LlamaCPP, any OpenAI-compatible endpoint)
7.0

Open-source RAG UI for chatting with your own documents, locally or self-hosted.

Free· Free, open-source (MIT-style); self-hosted infrastructure costs onlydocument-qaprivate-rag
MA

MaxKB

RAG · Multi-model
7.0

Open-source enterprise agent platform addressing high technical barriers, deployment costs, and iteration cycles in enterprise AI adoption.

FreemiumIntelligent customer serviceSmart office assistant
OP

OpenSandbox

Agents · Model-agnostic
7.0

OpenSandbox provides isolated environments for AI agents to execute code, use tools, and explore the web on user infrastructure.

Freemodel-generated code analysisparallel evaluation and training workloads
PR

PrivateGPT

RAG · Multi-model (BYO local LLM)
7.0

Open-source API layer that turns local models into production AI applications.

Free· OSS free; Zylon enterprise contract (contact sales)Context-aware AI apps based on documentsProduction AI applications
SY

SystemPrompt

Agents · Multi-model
7.0

SystemPrompt is a self-hosted control plane that sits between AI clients, model providers, and tools to manage access and audit.

Free· Evaluation and non-production use are freeModel access managementTool call governance
CO

Cohere

RAG · Command, Embed, Rerank, Transcribe (proprietary)
6.9

Cohere North is a complete agentic enterprise AI platform that users control and deploy on their terms.

EnterpriseBuilding custom agents to automate complex workflowsIntelligent search and discovery
DE

DeepSearcher

RAG · Multi-model (DeepSeek, OpenAI o1/o3-mini, Claude, Llama, others)
6.9

DeepSearcher combines LLMs and vector databases to perform search, evaluation, and reasoning based on private data.

FreeEnterprise knowledge managementIntelligent Q&A systems
FR

Frigate

Video · Custom object detection (Coral/YOLO/Frigate+ models)
6.9

Open-source NVR built around real-time AI object detection.

Freemium· Free and open-source; Frigate+ custom-model subscription is paidReal-time AI object detectionHome automation integration
KA

Katonic AI

Agents · Multi-model (2,600+ via AI Gateway)
6.9

Full-stack enterprise platform for building, deploying, and governing AI agents on your own infrastructure.

Enterprise· Contact sales for quote; no public pricingEnterprise agent building and orchestrationSovereign AI deployment on private infrastructure
TR

TrueFoundry

Agents · Multi-model
6.9

Enterprise control plane for deploying, governing, and scaling agentic AI on your own infrastructure.

Enterprise· Developer: $0 · Pro*: $499 · Pro Plus: $2999 · Enterprise: Customagent-deploymentllm-serving
EA

EKHOS AI

Audio · Proprietary local models
6.8

Private, offline transcription software for Windows.

Freemium· Free Plan: $0; Premium Plan: $12/month (monthly billing) or $108/year (annual billing, equivalent to $9/month)Audio transcriptionMicrophone recording
GP

GPTLocalhost

Writing · Bring-your-own (Ollama, LM Studio, llama.cpp, Foundry Local, etc.)
6.8

Free· Free planTranslationContract analysis
PG

Prediction Guard

Agents · Multi-model
6.6

Self-hosted AI control plane that lets regulated enterprises govern models, agents, and MCP servers behind their firewall.

Enterprise· Contact salesai-governanceself-hosted-llm
CL

ClickHouse

RAG

ClickHouse is an open, composable platform for data-intensive workloads including real-time analytics, transactions, observability, security, and AI engineering.

FreemiumReal-time analyticsObservability for SREs and agents
CO

CowAgent

Agents · Model-agnostic: Claude, GPT, Gemini, DeepSeek, Qwen, GLM, Kimi, MiniMax, Doubao

Open-source AI assistant and agent harness that plans tasks, runs tools and skills, and grows with long-term memory and knowledge.

FreeBuilding an evolving knowledge graphForming multi-agent teams for collaboration
GO

Goose

Agents · Provider-agnostic — Claude 3.5/4, GPT-4o/4.1, Gemini 1.5/2, Llama 3.x via Ollama, plus Azure OpenAI, Bedrock, OpenRouter and others

Native open source AI agent available as a desktop app, CLI, and API for code, workflows, and general tasks.

Free· Free and open source under Apache 2.0. You bring your own model API keys (or run local models via Ollama); provider costs are pass-through.Research, writing, automation, and data analysisCode review, research, and file processing
JE

JeecgBoot

Coding · Model-agnostic: ChatGPT, DeepSeek (default), Qwen, Ollama-hosted local models

JeecgBoot is an open-source enterprise AI low-code development platform with a code generator, online configuration, report dashboards, and an AI application platform.

FreemiumOA, ERP, CRM, and MIS systemsData report dashboards
ME

Meilisearch

RAG · Retrieval engine (Rust); pluggable embedders including OpenAI, Cohere, Hugging Face, Ollama and custom REST models

A flexible and powerful user-focused search engine that can be added to any website or application.

Freemium· Free plan; Cloud plan starting at $20/monthE-commerce product searchSaaS application search
ME

MemPalace

Agents · Embedding backends: embedding-gemma-300m (multilingual) or all-MiniLM-L6-v2 (English). No LLM required for retrieval.

Open-source, local-first AI memory system for LLM agents

Free· Free and open-source under the MIT license. No paid tiers; self-hosted with zero API costs once installed.Persistent memory for Claude Code and Cursor sessionsPer-agent memory isolation in multi-agent systems