Skip to main content
📖 The AI Tool Bible

AI tools tagged Supports Local Llm

48 tools matching this tag.model

All tags →
CL

Cline

Coding · Model-agnostic: Claude (Anthropic), GPT (OpenAI), Gemini (Google), DeepSeek, Grok, Mistral, Cerebras, plus local Ollama/LM Studio
8.7

Open-source agentic coding assistant that plans, edits, and runs code inside your IDE

Freemium· Free tierMulti-file feature scaffoldingLarge-scale refactors
AI

Aider

Coding · BYO (Claude / GPT-4 / Gemini / DeepSeek)
8.4

Terminal-based AI pair programmer that writes commits.

Free· Free / open-source; you pay the underlying LLM API costsCLIgit workflow
LL

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1
8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Freemiumself-hosted-llmfine-tuning
L3

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)
8.3

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Free· Weights free under Meta Llama Community License; inference cost via self-hosting or 3rd-party providerschatlong-context reasoning
LS

LM Studio

Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)
8.3

LM Studio Bionic is a natively local agent for open models built for creativity, work, and code.

Freemium· Free plan at $0; Bionic+ plan at $20 USD / month; Pro plan at $100 USD / monthCoding tasks and automationsReal-time voice transcription
JA

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)
8.2

Open-source desktop ChatGPT alternative that runs local LLMs and connects to cloud models.

FreeRunning open-source AI models locallyConnecting to cloud models like GPT and Claude
LI

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)
8.2

LibreChat brings together all AI conversations in one unified, customizable interface.

Free· Free and open source; self-hosted (you pay model providers for API usage)unified AI conversationsAI agents and tools
MS

Msty

Writing · Multi-model (Ollama, Claude, GPT, Gemini, others)
8.2

Freemium· Free: $0; Aurum: $149 USD per user / year; Aurum Lifetime: $349 USD per user (one-time purchase)
UN

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
LO

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)
8.1

LocalAI runs open models on the user's own hardware.

FreeChatting with open models on local hardwareRunning Python scripts on data files
PY

PyGPT

Writing · Multi-model (GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Ollama)
8.1

Open-source desktop AI assistant for Windows, Linux and macOS with agents, RAG, Python tools, MCP, vision, image/video generation and Ollama.

Free· Free and open-source (MIT); bring your own provider API keysdesktop-ai-assistantchat-with-files
AN

AnythingLLM

RAG · Multi-model
7.9

A private AI assistant that runs entirely on your computer with no accounts, API keys, or token limits.

Freemium· Basic: $50/monthly; Pro: $99/monthlyAutomating complex workflows with AI agentsRunning scheduled tasks
CO

Continue

Coding · BYO (any OpenAI-compatible API + Ollama for local)
7.9

Open-source, self-hostable VS Code/JetBrains AI assistant.

Free· Free / open-source; you pay model costsself-hostedopen source
KH

Khoj

Agents · Multi-model
7.9

Open-source personal AI that builds agents, searches your documents, and automates research across local files and the web.

Freemium· Free self-hosted; paid cloud tier on app.khoj.devpersonal-knowledge-baseagent-building
TY

TypingMind

Writing · Multi-model (GPT, Claude, Gemini, Mistral, DeepSeek, local)
7.7

BYOK chat frontend that puts GPT, Claude, Gemini, and local models behind one polished UI.

Paid· Standard: $39 · Extended: $79 · Premium: $99multi-model-chatprompt-library
OM

oMLX

Coding · Multi-model (Qwen, Llama, Mistral, Gemma, DeepSeek, MiniMax, GLM)
7.5

Native macOS LLM inference server built on MLX, with paged SSD KV caching for Apple Silicon agents.

Free· Free, Apache 2.0 open sourcelocal-llm-inferencecoding-agents
LC

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)
7.4

Local knowledge-based RAG and Agent application built with LangChain for LLMs like ChatGLM, Qwen, and Llama.

FreeLocal knowledge base Q&A applicationOffline private deployment
VO

Voicebox

Audio · Multi-model (Chatterbox, Qwen TTS, Whisper, etc.)
7.4

Open-source desktop voice studio for local cloning, dictation, and giving MCP agents a voice.

Free· Free and open source; optional $VOICEBOX token donationsvoice-cloningtext-to-speech
AS

AstrBot

Agents · Multi-model (OpenAI, Anthropic, Gemini, DeepSeek, Ollama, Dify, Coze)
7.3

Open-source agentic AI assistant that bridges chat platforms like Telegram, Discord, and QQ with any LLM and a 1000+ plugin ecosystem.

Free· Free, open-source (AGPL-3.0); self-hosted, you pay your own LLM API costs.chatbotgroup-chat-assistant
CS

Cherry Studio

Agents · Multi-model
7.2

Open-source desktop AI client that wires 300+ LLMs into one chat, knowledge-base, and agent workspace.

Free· Free and open source; bring your own API keysmulti-model chatlocal knowledge base
KA

Kiln AI

Evaluation · Multi-model
7.2

Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.

Freemium· Free Individual tier; Team (request access); Enterprise (custom)llm-evaluationfine-tuning
KC

Kilo Code

Coding · Multi-model (500+ via BYO keys or routing)
7.2

Open-source AI coding agent for VS Code, JetBrains, CLI, cloud agents, code reviews, and team workflows.

Freemium· Free plan with usage billed separately; Teams plan at $15 per user per month
LF

LLaMA Factory

Fine-tuning · Multi-model (LLaMA, Mistral, Qwen, Gemma, Phi, LLaVA, ChatGLM, Yi)
7.2

Open-source, no-code WebUI for fine-tuning 100+ open LLMs with LoRA, QLoRA, DPO, and PPO.

Free· Free, open-source (Apache-2.0); self-hostedlora-fine-tuningqlora
LB

LLM by Datasette

Coding · Multi-model
7.2

A CLI and Python library for running prompts against any LLM provider and logging everything to SQLite.

Free· Free and open source (Apache 2.0); pay underlying model providers separatelycli-promptingprompt-logging
LO

LobsterAI

Agents · Multi-model
7.2

LobsterAI is NetEase Youdao's open-source desktop agent for all-scenario office assistance.

Paid· New subscribers can unlock 1000 credits for ¥0.01Application developmentData analysis
OL

Ollama

Coding · Multi-model (Llama, Qwen, Gemma, DeepSeek, Mistral, Phi, etc.)
7.2

The de facto runtime for running open-weights LLMs locally, now with a paid cloud tier for bigger models.

Freemium· Free tier · from $20/molocal-llmself-hosted-inference
PI

Pieces

Coding · Multi-model (BYO OpenAI, Anthropic, Gemini, Ollama)
7.2

On-device long-term memory layer that feeds your last nine months of work context into any LLM or IDE assistant.

Freemium· Pro: $18.99 · Enterprise: $22.99developer-memorycode-snippets
KN

KNIME

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)
7.1

Data analytics and AI platform using a visual workflow builder with no coding required.

Freemiumdata analyticspredictive AI
OP

OpenClaw

Agents · Bring-your-own (Claude, GPT, others)
7.1

Open-source AI assistant that runs on your machine and works from WhatsApp, Telegram, or any chat app.

Free· Open source; you pay for the underlying LLM API usagePersistent memory for preferences and projectsTeam collaboration via shared gateway
PO

PostgresML

RAG · Multi-model (Llama, Mistral, open-source embeddings)
7.1

PostgresML is a Postgres extension that combines data storage and machine learning inference within the database.

Freemium· Serverless: From $7.50 per query hour; Dedicated: From $0.60 per instance hourRetrieval-Augmented GenerationVector search
AG

AgenticSeek

Agents · Bring-your-own local LLM (Ollama / llama.cpp compatible)
7.0

Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.

Free· Free and open source; optional SerpApi key for enhanced searchlocal-ai-agentautonomous-web-browsing
CH

ChatLab

Agents · Bring-your-own (local models recommended)
7.0

Local-first analytics and AI agent for your personal chat history, with bring-your-own model support.

Free· Free / open-source; bring-your-own AI modelchat-analyticspersonal-knowledge-mining
KO

Kotaemon

RAG · Multi-model (OpenAI, LlamaCPP, any OpenAI-compatible endpoint)
7.0

Open-source RAG UI for chatting with your own documents, locally or self-hosted.

Free· Free, open-source (MIT-style); self-hosted infrastructure costs onlydocument-qaprivate-rag
LL

llmfit

Evaluation · Multi-model
7.0

A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU.

FreeDetermining which open-source LLMs the hardware can runEstimating SSD capacity for keeping runnable models
OP

OpenCode

Coding · Multi-model (Claude, GPT, Gemini, local models, 75+ providers)
7.0

Freemium· Free models are included with no account required; Go plan is $10 per month; Go Plus plan is $40 per monthAI coding agentTerminal coding
PR

PrivateGPT

RAG · Multi-model (BYO local LLM)
7.0

Open-source API layer that turns local models into production AI applications.

Free· OSS free; Zylon enterprise contract (contact sales)Context-aware AI apps based on documentsProduction AI applications
BR

BrainSoup

Agents · Multi-model (ChatGPT, Mistral, local LLMs)
6.9

A native Windows desktop application for building and managing teams of AI agents.

Paid· Subscription starting at $5 per monthmulti-agent collaborationstask automation
CU

Chatbot UI

Writing · Multi-model (OpenAI, Anthropic, Google, Mistral, Meta, etc.)
6.9

Open-source unified chat interface for 80+ frontier AI models.

Freemium· Free tier on hosted app; self-host is free (bring your own API keys)multi-model chatprompt management
EL

Elephas

Writing · Multi-model (GPT-5, Claude, Gemini, BYO API)
6.9

Private AI for your own documents on Mac and Windows that answers with sources while keeping files stored on your computer.

Paid· Personal plan: $19/month or $15/month billed yearly ($180/year); Professional plan: $29/month or $24/month billed yearly ($288/year); Team plan: $29 per person/month or $24 per person/month billed yearly ($288 per person/year)Answering questions from contracts and client filesShared team knowledge base for contracts and policies
GP

GPTLocalhost

Writing · Bring-your-own (Ollama, LM Studio, llama.cpp, Foundry Local, etc.)
6.8

Free· Free planTranslationContract analysis
AU

AutoGen

Agents · Model-agnostic: OpenAI (GPT-4o, GPT-4.1, o-series), Azure OpenAI, Anthropic Claude, Google Gemini, Ollama, and any OpenAI-compatible local model (vLLM, llama.cpp)

Microsoft's open-source framework for multi-agent AI applications

Free· Free and open-source (MIT/CC-BY-4.0). You pay only for the underlying model providers (OpenAI, Azure OpenAI, Anthropic, local models, etc.) you plug into it.Coder and critic pair programming loopsMulti-agent research and report writing
AU

AutotuneLLM

Fine-tuning

An open-source optimization layer that sits between your app and Ollama to squeeze more performance out of local LLMs.

Free· Free and open source (MIT licensed).Local LLM inference on Apple SiliconReducing KV cache RAM for Ollama models
CO

CowAgent

Agents · Model-agnostic: Claude, GPT, Gemini, DeepSeek, Qwen, GLM, Kimi, MiniMax, Doubao

Open-source AI assistant and agent harness that plans tasks, runs tools and skills, and grows with long-term memory and knowledge.

FreeBuilding an evolving knowledge graphForming multi-agent teams for collaboration
CR

Crush

Coding · Provider-agnostic: Anthropic Claude, OpenAI GPT, Google Gemini, Groq, Cerebras, OpenRouter, Bedrock, VertexAI, Azure OpenAI, Ollama, llama.cpp, LM Studio, and any OpenAI/Anthropic-compatible endpoint

Glamourous agentic coding for your terminal

Freemium· Free: $0 USD · Team: $4 USD per user/month · Enterprise: $21 USD per user/monthAgentic code refactoring in the terminalMulti-file feature implementation with LSP context
GO

Goose

Agents · Provider-agnostic — Claude 3.5/4, GPT-4o/4.1, Gemini 1.5/2, Llama 3.x via Ollama, plus Azure OpenAI, Bedrock, OpenRouter and others

Native open source AI agent available as a desktop app, CLI, and API for code, workflows, and general tasks.

Free· Free and open source under Apache 2.0. You bring your own model API keys (or run local models via Ollama); provider costs are pass-through.Research, writing, automation, and data analysisCode review, research, and file processing
HY

Hydra

Agents · Multi-provider: routes across Claude, GPT, Gemini Flash, OpenRouter-hosted models, and local Qwen via Ollama / LM Studio

Free· Open Source plan is $0.00 with unlimited seats and requests, including every feature and commandCost-optimized task routingOn-device audit ledger for AI usage
LM

Language Model Builder

Fine-tuning · In-house small transformer models trained by the user; exports to safetensors

Language Model Builder explains the foundations of AI tools and lets users build models from scratch.

Free· Free download with no account or subscription requiredBuilding a tokenizer and inspecting attentionChatting with a self-trained model
LO

LobeHub

Agents · OpenAI GPT-4o/o1, Anthropic Claude 3.5/4, Google Gemini, DeepSeek, Mistral, Ollama, and 40+ other providers (bring-your-own-key)

Open-source AI agent platform and chat UI supporting every major LLM, plugins, and multi-agent workflows.

Freemium· Free tierSelf-hosted ChatGPT alternativeMulti-provider LLM comparison