AnythingLLM alternatives
6 rag tools in the same lane as AnythingLLM, ranked by editorial score.
PR
PrivateGPT
RAG · Multi-model (BYO local LLM)
7.0
Production-ready, air-gapped RAG framework for querying your documents with local LLMs.
Freemium· OSS free; Zylon enterprise contract (contact sales)private-ragchat-with-documents
KO
Kotaemon
RAG · Multi-model (OpenAI, LlamaCPP, any OpenAI-compatible endpoint)
7.0
Open-source RAG UI for chatting with your own documents, locally or self-hosted.
Free· Free, open-source (MIT-style); self-hosted infrastructure costs onlydocument-qaprivate-rag
LC
Langchain-Chatchat
RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)
7.4
Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.
Free· Apache-2.0 open source; self-hosted, infra costs onlyprivate-knowledge-baseoffline-rag
QU
Quivr
RAG · Multi-model (OpenAI, Anthropic, Mistral, Gemma)
8.4
Open-source RAG framework for building custom AI assistants over your own documents in a few lines of Python.
Free· Open source (pip install quivr-core); pay only for LLM/vector-store usagedocument-qacustom-knowledge-base
RA
RAGFlow
RAG · Multi-model
8.1
Open-source RAG engine with deep document parsing, hybrid search, and visual agent orchestration.
Freemium· Free tier; Starter $29/mo; Pro $129/mo; Enterprise customdocument-qaenterprise-search
MA
MaxKB
RAG · Multi-model
7.0
Open-source enterprise RAG and agent platform with built-in workflow engine and multi-LLM support.
Freemium· Community edition free (GPLv3); paid enterprise editionenterprise-knowledge-basecustomer-support-bots