AI tools tagged Supports Local Llm

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)

8.2

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)

7.4

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Voicebox

Audio · Multi-model (Chatterbox, Qwen TTS, Whisper, etc.)

7.4

Open-source desktop voice studio for local cloning, dictation, and giving MCP agents a voice.

Open Deep Research

Agents · o3-mini (default), DeepSeek R1, or any OpenAI-compatible model

7.2

Minimal open-source deep-research agent that iteratively searches, scrapes, and reasons to produce cited markdown reports.

KNIME

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)

7.1

Visual node-based data science platform with built-in connectors for OpenAI, Anthropic, Gemini, and local LLMs.

AgenticSeek

Agents · Bring-your-own local LLM (Ollama / llama.cpp compatible)

7.0

Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.

PrivateGPT

RAG · Multi-model (BYO local LLM)

7.0

Production-ready, air-gapped RAG framework for querying your documents with local LLMs.

BrainSoup

Agents · Multi-model (ChatGPT, Mistral, local LLMs)

6.9

Windows desktop app for building teams of specialized AI agents that collaborate through chat.

GPTLocalhost

Writing · Bring-your-own (Ollama, LM Studio, llama.cpp, Foundry Local, etc.)

6.8

Run local LLMs directly inside Microsoft Word without sending text to the cloud.

AutotuneLLM

Fine-tuning

An open-source optimization layer that sits between your app and Ollama to squeeze more performance out of local LLMs.

Horch

Audio · Whisper (local) for transcription; optional Ollama / MLX local LLMs for summarization

Privacy-first, on-device meeting assistant for macOS

Threadfork

Audio · On-device local LLMs running on Apple Silicon (specific model family undisclosed)

Private, local-first AI meeting notetaker for macOS