AI tools tagged On Premise
48 tools matching this tag.tech
Stable Diffusion
Open-source image generation — run anywhere, fine-tune anything.
Elasticsearch Vector Search
Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine
IBM watsonx
Enterprise AI platform for building, deploying, and governing models and agents
Palantir AIP
Enterprise AI platform that grounds LLMs in your operational data and runs agents against real business systems.
Llama
Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.
vLLM
Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.
Vespa
Yahoo's open-source search engine with vector + sparse retrieval.
Lambda
On-demand NVIDIA GPU cloud built specifically for training, fine-tuning, and serving large AI models.
LocalAI
Self-hosted OpenAI-compatible API for running LLMs, image, and audio models on your own hardware.
Continue
Open-source, self-hostable VS Code/JetBrains AI assistant.
DataRobot
Enterprise platform for building, deploying, and governing AI agents alongside classic predictive ML.
Lamini
Memory-tuning platform for grounding LLMs in your facts.
Modzy
Enterprise ModelOps platform for deploying and running AI/ML models across cloud, on-prem, and edge.
Tabnine
Privacy-focused AI autocomplete with on-prem options.
Kong AI Gateway
Enterprise API gateway extended to route, govern, and observe LLM and agent traffic across providers.
Kubeflow
Open-source toolkit for running the full ML lifecycle on Kubernetes.
Pachyderm
Kubernetes-native data versioning and pipeline engine for reproducible ML at petabyte scale.
Seldon
Kubernetes-native MLOps platform for deploying and orchestrating ML and generative AI models in production.
Domino Data Lab
Enterprise AI platform for building, deploying, and governing models and agents at scale.
SAS Viya
Enterprise-grade data and AI analytics platform with built-in governance, MCP server, and a Copilot for regulated industries.
Wallaroo.AI
Production AI inference platform for deploying and monitoring models across cloud, on-prem, and edge.
Fiddler AI
Enterprise AI observability and guardrails platform for monitoring agents, LLMs, and ML models in production.
Iguazio
Enterprise MLOps and GenAI platform for taking models from notebook to production at scale.
iii
Self-hosted distributed runtime for multi-language workers and AI agents under one protocol.
Neu.ro
Infrastructure-agnostic MLOps platform for the full ML/DL lifecycle across public, hybrid, and on-prem clouds.
PostgresML
PostgreSQL extension that runs embeddings, vector search, and LLM inference inside your database.
Scale GenAI Platform
Enterprise agent platform from Scale AI that connects your data, orchestrates multi-agent workflows, and learns from human feedback inside your own VPC.
Tiledesk
Open-source conversational AI platform for building multi-channel support agents and automation workflows.
Bisheng
Open-source enterprise AgentOps platform for building, orchestrating, and governing LLM agents at scale.
Kotaemon
Open-source RAG UI for chatting with your own documents, locally or self-hosted.
MaxKB
Open-source enterprise RAG and agent platform with built-in workflow engine and multi-LLM support.
OpenSandbox
Open-source sandbox infrastructure for running AI-generated code, agents, and browsers in isolated Docker or Kubernetes environments.
PrivateGPT
Production-ready, air-gapped RAG framework for querying your documents with local LLMs.
SystemPrompt
Self-hosted AI governance gateway that audits, gates, and logs every LLM call before it leaves your network.
Cohere
Enterprise-grade LLM platform built for private, secure, and customizable deployment.
DeepSearcher
Open-source agentic RAG framework for private enterprise data, built by the Zilliz/Milvus team.
Frigate
Open-source NVR that runs AI object detection locally on your security camera feeds.
Katonic AI
Sovereign enterprise platform for building, deploying, and governing AI agents on your own infrastructure.
TrueFoundry
Enterprise control plane for deploying, governing, and scaling agentic AI on your own infrastructure.
EKHOS AI
Offline Windows transcription app with speaker diarization, GPU acceleration, and 98-language support.
GPTLocalhost
Run local LLMs directly inside Microsoft Word without sending text to the cloud.
Prediction Guard
Self-hosted AI control plane that lets regulated enterprises govern models, agents, and MCP servers behind their firewall.
ClickHouse
The open-source columnar database powering real-time analytics — and, increasingly, LLM observability and RAG backends.
CowAgent
Open-source, self-hosted AI agent framework that plans, uses tools, and executes multi-step tasks.
Goose
Open-source, local-first AI agent for code, workflows, and everything in between.
JeecgBoot
Open-source enterprise low-code platform with a pluggable AI code generator, RAG knowledge base and MCP agent tooling.
Meilisearch
Open-source, lightning-fast search engine with built-in hybrid and vector search for RAG
MemPalace
Open-source, local-first AI memory system for LLM agents