AI tools tagged Supports Local Llm

Open-source agentic coding assistant that plans, edits, and runs code inside your IDE

Terminal-based AI pair programmer that writes commits.

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Desktop app for discovering, downloading, and running open-weight LLMs locally with an OpenAI-compatible server.

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Privacy-first desktop AI workspace that runs local and cloud models side by side.

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Self-hosted OpenAI-compatible API for running LLMs, image, and audio models on your own hardware.

Open-source desktop AI assistant that wires every major LLM provider into one local app with agents, vision, and a code interpreter.

Open-source desktop and self-hosted app that turns your documents into a private chat-and-agent workspace.

Open-source, self-hostable VS Code/JetBrains AI assistant.

Open-source personal AI that builds agents, searches your documents, and automates research across local files and the web.

BYOK chat frontend that puts GPT, Claude, Gemini, and local models behind one polished UI.

Native macOS LLM inference server built on MLX, with paged SSD KV caching for Apple Silicon agents.

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Open-source desktop voice studio for local cloning, dictation, and giving MCP agents a voice.

Open-source agentic AI assistant that bridges chat platforms like Telegram, Discord, and QQ with any LLM and a 1000+ plugin ecosystem.

Open-source desktop AI client that wires 300+ LLMs into one chat, knowledge-base, and agent workspace.

Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.

Open-source agentic coding assistant for VS Code, JetBrains, and the terminal with bring-your-own-key routing across 500+ models.

Open-source, no-code WebUI for fine-tuning 100+ open LLMs with LoRA, QLoRA, DPO, and PPO.

A CLI and Python library for running prompts against any LLM provider and logging everything to SQLite.

Youdao's 24/7 personal agent that runs locally, plugs into multiple LLMs, and automates office workflows via dialogue and skills.

The de facto runtime for running open-weights LLMs locally, now with a paid cloud tier for bigger models.

On-device long-term memory layer that feeds your last nine months of work context into any LLM or IDE assistant.

Visual node-based data science platform with built-in connectors for OpenAI, Anthropic, Gemini, and local LLMs.

Open-source local AI agent that controls your computer and talks back through your messaging apps.

PostgreSQL extension that runs embeddings, vector search, and LLM inference inside your database.

Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.

Local-first analytics and AI agent for your personal chat history, with bring-your-own model support.

Open-source RAG UI for chatting with your own documents, locally or self-hosted.

Terminal tool that scores hundreds of open LLMs against your actual CPU, RAM, and GPU and tells you which ones will run well.

Open-source AI coding agent that runs in your terminal, IDE, or desktop and talks to 75+ LLM providers.

Production-ready, air-gapped RAG framework for querying your documents with local LLMs.

Windows desktop app for building teams of specialized AI agents that collaborate through chat.

Open-source unified chat interface for 80+ frontier AI models.

Privacy-first Mac AI writing assistant that redacts PII before any cloud call and indexes your files locally.

Run local LLMs directly inside Microsoft Word without sending text to the cloud.

Microsoft's open-source framework for multi-agent AI applications

An open-source optimization layer that sits between your app and Ollama to squeeze more performance out of local LLMs.

Open-source, self-hosted AI agent framework that plans, uses tools, and executes multi-step tasks.

Glamourous agentic coding for your terminal

Open-source, local-first AI agent for code, workflows, and everything in between.

Local-first trust control plane that routes AI tasks to the cheapest model that clears your confidence bar.

Learn how LLMs work by building one on your Mac

Open-source AI agent platform and chat UI supporting every major LLM, plugins, and multi-agent workflows.