Skip to main content
📖 The AI Tool Bible

Self-hosted AI tools

Editorial picks for "self hosted ai".

48 tools

Quivr preview image
Quivr logo

Quivr

RAG · Multi-model (OpenAI, Anthropic, Mistral, Gemma)
8.4

Open-source RAG framework for building custom AI assistants over your own documents in a few lines of Python.

Free· Open source (pip install quivr-core); pay only for LLM/vector-store usagedocument-qacustom-knowledge-base
Arize AI preview image
Arize AI logo

Arize AI

Evaluation · Multi-model
8.2

Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Freemium· AX Free: Free · AX Pro: $50 · AX Enterprise: Customllm-observabilityagent-evaluation
Browser Use preview image
Browser Use logo

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)
8.2

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Freemium· PAYG: $0 · Dev: $29 · Business: $299 · Scaleup: $999web-automationscraping
HyperFrames preview image
HyperFrames logo

HyperFrames

Video · Multi-model (Claude Code skill; BYO agent)
8.2

Open-source video composition framework that lets AI agents build videos by writing HTML, CSS, and JS.

Free· Free, open-source (Apache 2.0)agent-driven videoprogrammatic video
Jan preview image
Jan logo

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)
8.2

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

Free· Free and open source; bring-your-own keys for cloud modelslocal-llm-chatprivate-ai-assistant
LibreChat preview image
LibreChat logo

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)
8.2

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Free· Free and open source; self-hosted (you pay model providers for API usage)multi-model chatself-hosted chatgpt
Langflow preview image
Langflow logo

Langflow

Agents · Multi-model
8.1

Open-source visual builder for LangChain-style AI agents and RAG pipelines.

Freemium· Open-source free; hosted free tier + paid enterprise via DataStaxagent-prototypingrag-pipelines
MLflow preview image
MLflow logo

MLflow

Evaluation · Multi-model
8.1

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Free· Free and open source (Apache 2.0); managed offering via Databricksllm-evaluationexperiment-tracking
OpenHands preview image
OpenHands logo

OpenHands

Agents · Multi-model (Claude, Gemini, GPT/Codex)
8.0

Open-source autonomous coding agent that plans, edits, and ships changes across real codebases.

Freemium· Open Source: Free · Individual: Free · Enterprise: Custom pricingautonomous-codingpr-review
pgMagic preview image
pgMagic logo

pgMagic

Coding · OpenAI (user-supplied API key)
8.0

Mac desktop client that lets you chat with your Postgres database in natural language using your own OpenAI key.

Paid· AU$22 one-time license; bring your own OpenAI API keynatural-language-to-sqlpostgres-client
Rivet preview image
Rivet logo

Rivet

Agents · Multi-model
8.0

Open-source visual IDE for building and debugging LLM agent graphs.

Free· Free and open source (MIT)agent-orchestrationprompt-chaining
Khoj preview image
Khoj logo

Khoj

Agents · Multi-model
7.9

Open-source personal AI that builds agents, searches your documents, and automates research across local files and the web.

Freemium· Free self-hosted; paid cloud tier on app.khoj.devpersonal-knowledge-baseagent-building
TypingMind preview image
TypingMind logo

TypingMind

Writing · Multi-model (GPT, Claude, Gemini, Mistral, DeepSeek, local)
7.7

BYOK chat frontend that puts GPT, Claude, Gemini, and local models behind one polished UI.

Paid· Standard: $39 · Extended: $79 · Premium: $99multi-model-chatprompt-library
Langchain-Chatchat preview image
Langchain-Chatchat logo

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)
7.4

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Free· Apache-2.0 open source; self-hosted, infra costs onlyprivate-knowledge-baseoffline-rag
Model Context Protocol preview image
Model Context Protocol logo

Model Context Protocol

Agents · Model-agnostic
7.4

Open standard that lets AI apps plug into data sources, tools, and workflows like USB-C for LLMs.

Free· Free and open source (MIT)agent-toolingide-integrations
AstrBot preview image
AstrBot logo

AstrBot

Agents · Multi-model (OpenAI, Anthropic, Gemini, DeepSeek, Ollama, Dify, Coze)
7.3

Open-source agentic AI assistant that bridges chat platforms like Telegram, Discord, and QQ with any LLM and a 1000+ plugin ecosystem.

Free· Free, open-source (AGPL-3.0); self-hosted, you pay your own LLM API costs.chatbotgroup-chat-assistant
Gorilla preview image
Gorilla logo

Gorilla

Agents · gorilla-openfunctions-v2 (6.91B)
7.3

Open-source LLM purpose-built for function calling and API invocation across thousands of tools.

Free· Free and Apache 2.0; self-hostedfunction-callingtool-use
Pathway preview image
Pathway logo

Pathway

RAG · Multi-model
7.3

Live data framework for production RAG and streaming ETL pipelines in Python.

Freemium· Community free (BSL 1.1, 8GB/4 cores); Scale and Enterprise tiers with license keylive-ragstreaming-etl
AI-Flow preview image
AI-Flow logo

AI-Flow

Agents · Multi-model (OpenAI, Anthropic, Google, Replicate, xAI)
7.2

Visual node-based builder for chaining OpenAI, Anthropic, Replicate and other model APIs into content pipelines.

Freemium· Free tier: 25 welcome credits + 20 BYOK runs/day; paid plans for extended storageworkflow-automationcontent-pipelines
DeerFlow preview image
DeerFlow logo

DeerFlow

Agents · Multi-model (Doubao, DeepSeek, OpenAI, Gemini)
7.2

Open-source multi-agent framework from ByteDance for long-running research, coding, and content tasks.

Free· Free, MIT-licensed (self-hosted; you pay only for LLM tokens)deep-researchautonomous-coding
Hermes One preview image
Hermes One logo

Hermes One

Agents · Multi-model (BYO via OpenRouter/OpenAI/Anthropic/Gemini/xAI/Ollama)
7.2

Open-source desktop AI agent with a self-improving learning loop and multi-platform messaging connectors.

Free· Free, MIT-licensed; you pay your own model inference costsautonomous-agentschat-ops
Kiln AI preview image
Kiln AI logo

Kiln AI

Evaluation · Multi-model
7.2

Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.

Freemium· Free Individual tier; Team (request access); Enterprise (custom)llm-evaluationfine-tuning
Nexent preview image
Nexent logo

Nexent

Agents · Multi-model (OpenAI-compatible: any LLM/Embedding/VLM/STT/TTS)
7.2

Open-source, zero-code platform for spinning up production-grade AI agents from a single natural-language prompt.

Free· Free, open-source (MIT); self-hosted infra + model API costs applymulti-agent-orchestrationzero-code-agents
WeKnora preview image
WeKnora logo

WeKnora

RAG · Multi-model
7.2

Tencent's open-source RAG framework that turns raw documents into a queryable knowledge base, ReAct agent, and self-maintaining wiki.

Free· Free, open-source (self-hosted)document-qaenterprise-knowledge-base
Serena preview image
Serena logo

Serena

Agents · Bring your own (Claude, GPT, etc.)
7.1

Open-source MCP toolkit that gives coding agents IDE-grade symbol search, refactoring, and editing across 40+ languages.

Freemium· Core server free (MIT); optional JetBrains plugin is paid with free trialagent-codingrefactoring
PySpur preview image
PySpur logo

PySpur

Agents · Multi-model
7.0

Open-source agent builder with a drag-and-drop canvas, Python escape hatch, and a built-in test harness.

Freemium· Basic: $10 · Pro: $20 · Enterprise: Contact salesagent-orchestrationagent-evaluation
RAGs by LlamaIndex preview image
RAGs by LlamaIndex logo

RAGs by LlamaIndex

RAG · Multi-model (OpenAI, Anthropic, Replicate, HuggingFace)
7.0

Open-source Streamlit app that builds a custom RAG pipeline from a natural-language brief.

Free· Free, MIT-licensed; bring your own model/API keysnatural-language-rag-builderdocument-qa
Superduper preview image
Superduper logo

Superduper

RAG · Multi-model
7.0

Enterprise AI agent orchestration that brings RAG and agents to your existing data stack without migration.

Enterprise· Free trial on Snowflake Marketplace; enterprise self-hosted pricing on requestin-database-ragagent-orchestration
SystemPrompt preview image
SystemPrompt logo

SystemPrompt

Agents · Multi-model
7.0

Self-hosted AI governance gateway that audits, gates, and logs every LLM call before it leaves your network.

Freemium· Free self-hosted tier; commercial licensing on requestai-governancellm-gateway
Chatbot UI preview image
Chatbot UI logo

Chatbot UI

Writing · Multi-model (OpenAI, Anthropic, Google, Mistral, Meta, etc.)
6.9

Open-source unified chat interface for 80+ frontier AI models.

Freemium· Free tier on hosted app; self-host is free (bring your own API keys)multi-model chatprompt management
Chat With PDF by Copilot.us preview image
Chat With PDF by Copilot.us logo

Chat With PDF by Copilot.us

RAG
6.9

Conversational PDF Q&A bundled into a multi-app productivity membership.

Freemium· 7-day free trial; paid membership covers full app suitepdf-qadocument-summarization
CocoIndex preview image
CocoIndex logo

CocoIndex

RAG · Bring-your-own (embeddings + LLM)
6.9

Open-source incremental data framework that keeps RAG indexes and agent context continuously fresh.

Free· Open-source, self-hosted; bring your own infracode-indexingrag-pipelines
Count preview image
Count logo

Count

Agents · Multi-model (Anthropic, OpenAI, Google)
6.9

Collaborative AI-powered data canvas that blends SQL, Python, and natural-language agents for team analytics.

Freemium· Free; Pro $49/editor/mo; Scale $69/editor/mo (15-seat min); Enterprise customcollaborative-analyticsai-data-exploration
Haystack preview image
Haystack logo

Haystack

RAG · Multi-model
6.9

Open-source Python framework from deepset for building production RAG pipelines and LLM agents.

Freemium· Open-source free; deepset Enterprise Support and AI Platform via salesragagents
MemOS preview image
MemOS logo

MemOS

Agents · Multi-model
6.9

Memory operating system that gives LLM agents long-term, structured recall across sessions and models.

Freemium· 免费版: ¥0 元 · 入门版: ¥0 元原价 150元/月 · 专业版: ¥0 元原价 2000元/月 · 企业版: 灵活定价agent-memorylong-term-context
QuickCreator preview image
QuickCreator logo

QuickCreator

Writing · Gemini
6.9

Multi-agent SEO blog writer aimed at solo founders who want to rank on Google and get cited by ChatGPT.

Freemium· Personal: $29 · Professional: $129 · Plus: $249 · Enterprise: Customseo-blog-writingcontent-strategy
DagsHub preview image
DagsHub logo

DagsHub

Fine-tuning
6.8

GitHub-style collaboration platform for ML datasets, experiments, and models with MLflow and DVC under the hood.

Freemium· Individual: $0 per user/month · Team: $119 per user/month · Enterprise: Custom quoteexperiment-trackingdata-versioning
gotoHuman preview image
gotoHuman logo

gotoHuman

Agents
6.8

Human-in-the-loop review layer for AI agents and automated workflows.

Freemium· Free: $0 · Team: $99 · Growth: $350 · Business: $950human-in-the-loopagent-oversight
Harmonai preview image
Harmonai logo

Harmonai

Audio · Dance Diffusion / Stable Audio family
6.8

Open-source generative audio lab from Stability AI building diffusion models for music production.

Free· Free open-source models and code; no hosted product on this sitemusic-generationsound-design
Yuxi preview image
Yuxi logo

Yuxi

RAG · Multi-model
6.8

Open-source AI agent platform that fuses agentic RAG with knowledge graphs on a LangGraph runtime.

Free· Free, MIT-licensed self-hostagentic-ragknowledge-graphs
Lavender preview image
Lavender logo

Lavender

Writing · Multi-model (OpenAI + fine-tuned in-house LLMs)
6.7

AI email coach that grades and rewrites sales outreach in real time, inside your inbox.

Freemium· Free Starter tier; paid Pro and Teams plans (per seat, contact sales for Teams)sales-emailcold-outreach
Wan AI preview image
Wan AI logo

Wan AI

Video · Wan 2.1 / Wan 2.2
6.5

Alibaba's generative video and image playground, wrapping the open Wan model family in a consumer web app.

Freemiumtext-to-videoimage-to-video
Chat2DB preview image
Chat2DB logo

Chat2DB

Coding · Model-agnostic: OpenAI GPT-4o, Anthropic Claude, Google Gemini, DeepSeek, Qwen, and self-hosted Ollama/vLLM endpoints

AI-native SQL client and Text-to-SQL copilot for 30+ databases

Freemium· PRO: Contact Us · ENTERPRISE: Contact UsNatural-language SQL queryingMulti-database GUI client
Chatbot by Vercel preview image
Chatbot by Vercel logo

Chatbot by Vercel

Coding · Provider-agnostic via the Vercel AI SDK (OpenAI, Anthropic, Google, xAI, Groq, Mistral, and others configurable)

Open-source Next.js chatbot template built on the Vercel AI SDK

Free· Free and open-source (MIT-style). Users cover their own hosting costs (e.g. Vercel plan) and AI provider API usage.Internal engineering copilotCustomer-facing support chatbot
Chroma MCP logo

Chroma MCP

MCP Servers

Official MCP server that gives LLM clients direct access to the Chroma vector database.

Free· Open source (Apache 2.0). Free to run locally or self-hosted; embedding-function API keys (OpenAI, Cohere, Jina, VoyageAI, Roboflow) billed by those providers. Chroma Cloud pricing set separately by Chroma.Long-term memory for Claude DesktopTeam knowledge base shared across agents
Cloudflare MCP Server logo

Cloudflare MCP Server

MCP Servers

Official suite of remote MCP servers that let Claude, Cursor, and other agents read and control your Cloudflare account.

Freemium· Free: $0 USD · Team: $4 USD per user/month · Enterprise: $21 USD per user/monthDebugging Workers with live logs from chatDeploying and configuring Workers bindings
CowAgent preview image
CowAgent logo

CowAgent

Agents · Model-agnostic: Claude, GPT, Gemini, DeepSeek, Qwen, GLM, Kimi, MiniMax, Doubao

Open-source, self-hosted AI agent framework that plans, uses tools, and executes multi-step tasks.

Free· Free and open source under MIT License; users bring their own model API keys (e.g. OpenAI, Anthropic, DeepSeek) and pay those providers directly.Autonomous research assistantSelf-hosted coding agent
Dify preview image
Dify logo

Dify

Agents · Model-agnostic: OpenAI (GPT-4o, GPT-4.1), Anthropic Claude, Google Gemini, Mistral, Cohere, Ollama, and any OpenAI-compatible endpoint

Open-source LLMOps platform for building agentic workflows, RAG pipelines, and AI applications

Freemium· Professional: $590 · Team: $1590 · Sandbox: Free · Enterprise: Custom · Community: FreeRAG chatbot over internal documentsCustomer support automation