📖 The AI Tool Bible

AI tools tagged Supports Local Llm

9 tools matching this tag.model

All tags →

AgenticSeek

Agents · Bring-your-own local LLM (Ollama / llama.cpp compatible)

Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.

Free· Free and open source; optional SerpApi key for enhanced searchlocal-ai-agentautonomous-web-browsing

BrainSoup

Agents · Multi-model (ChatGPT, Mistral, local LLMs)

Windows desktop app for building teams of specialized AI agents that collaborate through chat.

Freemium· From $5/month, no commitmentmulti-agent workflowsdesktop AI assistant

GPTLocalhost

Writing · Bring-your-own (Ollama, LM Studio, llama.cpp, Foundry Local, etc.)

Run local LLMs directly inside Microsoft Word without sending text to the cloud.

Freemium· Free tier (512-char limit); paid monthly subscription and lifetime license availableprivate draftingoffline writing assistant

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

Free· Free and open source; bring-your-own keys for cloud modelslocal-llm-chatprivate-ai-assistant

KNIME

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)

Visual node-based data science platform with built-in connectors for OpenAI, Anthropic, Gemini, and local LLMs.

Freemium· Free open-source desktop; Team and Business Hub plans paiddata-pipelinesllm-workflows

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Free· Apache-2.0 open source; self-hosted, infra costs onlyprivate-knowledge-baseoffline-rag

Open Deep Research

Agents · o3-mini (default), DeepSeek R1, or any OpenAI-compatible model

Minimal open-source deep-research agent that iteratively searches, scrapes, and reasons to produce cited markdown reports.

Free· Free (MIT); bring your own Firecrawl + LLM API keysdeep-researchagent-scaffolding

PrivateGPT

RAG · Multi-model (BYO local LLM)

Production-ready, air-gapped RAG framework for querying your documents with local LLMs.

Freemium· OSS free; Zylon enterprise contract (contact sales)private-ragchat-with-documents

Voicebox

Audio · Multi-model (Chatterbox, Qwen TTS, Whisper, etc.)

Open-source desktop voice studio for local cloning, dictation, and giving MCP agents a voice.

Free· Free and open source; optional $VOICEBOX token donationsvoice-cloningtext-to-speech