Self-hosted AI tools
Editorial picks for "self hosted ai".
48 tools

Quivr
Open-source RAG framework for building custom AI assistants over your own documents in a few lines of Python.

Arize AI
Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Browser Use
Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

HyperFrames
Open-source video composition framework that lets AI agents build videos by writing HTML, CSS, and JS.

Jan
Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

LibreChat
Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Langflow
Open-source visual builder for LangChain-style AI agents and RAG pipelines.

MLflow
Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

OpenHands
Open-source autonomous coding agent that plans, edits, and ships changes across real codebases.

pgMagic
Mac desktop client that lets you chat with your Postgres database in natural language using your own OpenAI key.

Rivet
Open-source visual IDE for building and debugging LLM agent graphs.

Khoj
Open-source personal AI that builds agents, searches your documents, and automates research across local files and the web.

TypingMind
BYOK chat frontend that puts GPT, Claude, Gemini, and local models behind one polished UI.

Langchain-Chatchat
Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Model Context Protocol
Open standard that lets AI apps plug into data sources, tools, and workflows like USB-C for LLMs.

AstrBot
Open-source agentic AI assistant that bridges chat platforms like Telegram, Discord, and QQ with any LLM and a 1000+ plugin ecosystem.

Gorilla
Open-source LLM purpose-built for function calling and API invocation across thousands of tools.

Pathway
Live data framework for production RAG and streaming ETL pipelines in Python.

AI-Flow
Visual node-based builder for chaining OpenAI, Anthropic, Replicate and other model APIs into content pipelines.

DeerFlow
Open-source multi-agent framework from ByteDance for long-running research, coding, and content tasks.

Hermes One
Open-source desktop AI agent with a self-improving learning loop and multi-platform messaging connectors.

Kiln AI
Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.

Nexent
Open-source, zero-code platform for spinning up production-grade AI agents from a single natural-language prompt.

WeKnora
Tencent's open-source RAG framework that turns raw documents into a queryable knowledge base, ReAct agent, and self-maintaining wiki.

Serena
Open-source MCP toolkit that gives coding agents IDE-grade symbol search, refactoring, and editing across 40+ languages.

PySpur
Open-source agent builder with a drag-and-drop canvas, Python escape hatch, and a built-in test harness.

RAGs by LlamaIndex
Open-source Streamlit app that builds a custom RAG pipeline from a natural-language brief.

Superduper
Enterprise AI agent orchestration that brings RAG and agents to your existing data stack without migration.

SystemPrompt
Self-hosted AI governance gateway that audits, gates, and logs every LLM call before it leaves your network.

Chatbot UI
Open-source unified chat interface for 80+ frontier AI models.

Chat With PDF by Copilot.us
Conversational PDF Q&A bundled into a multi-app productivity membership.

CocoIndex
Open-source incremental data framework that keeps RAG indexes and agent context continuously fresh.

Count
Collaborative AI-powered data canvas that blends SQL, Python, and natural-language agents for team analytics.

Haystack
Open-source Python framework from deepset for building production RAG pipelines and LLM agents.

MemOS
Memory operating system that gives LLM agents long-term, structured recall across sessions and models.

QuickCreator
Multi-agent SEO blog writer aimed at solo founders who want to rank on Google and get cited by ChatGPT.

DagsHub
GitHub-style collaboration platform for ML datasets, experiments, and models with MLflow and DVC under the hood.

gotoHuman
Human-in-the-loop review layer for AI agents and automated workflows.

Harmonai
Open-source generative audio lab from Stability AI building diffusion models for music production.

Yuxi
Open-source AI agent platform that fuses agentic RAG with knowledge graphs on a LangGraph runtime.

Lavender
AI email coach that grades and rewrites sales outreach in real time, inside your inbox.

Wan AI
Alibaba's generative video and image playground, wrapping the open Wan model family in a consumer web app.

Chat2DB
AI-native SQL client and Text-to-SQL copilot for 30+ databases

Chatbot by Vercel
Open-source Next.js chatbot template built on the Vercel AI SDK
Chroma MCP
Official MCP server that gives LLM clients direct access to the Chroma vector database.
Cloudflare MCP Server
Official suite of remote MCP servers that let Claude, Cursor, and other agents read and control your Cloudflare account.

CowAgent
Open-source, self-hosted AI agent framework that plans, uses tools, and executes multi-step tasks.

Dify
Open-source LLMOps platform for building agentic workflows, RAG pipelines, and AI applications