Skip to main content
📖 The AI Tool Bible

SillyTavern

Locally installed power-user frontend for chatting with LLMs, image models, and TTS backends

Free· Free and open source (AGPL-3.0). Users pay only for whichever backend they connect (OpenAI, Claude, local models via KoboldCpp/Ooba/Tabby, AI Horde, etc.).WritingBackend-agnostic — OpenAI, Anthropic Claude, Google Gemini, Mistral, OpenRouter, KoboldAI/KoboldCpp, Text-Generation-WebUI, Tabby, llama.cpp, NovelAI, AI Horde, any OpenAI-compatible endpoint
Visit website →
Best for

AI hobbyists, roleplayers, and interactive-fiction writers who want a locally hosted frontend with total control over prompts, samplers, personas, and world info across any LLM backend.

Skip if

Non-technical users looking for a click-to-chat SaaS product, or teams needing multi-user collaboration, SSO, audit logs, or vendor support.

SillyTavern is a self-hosted, browser-based frontend for interacting with text-generation LLMs, image-generation engines, and TTS models. Originally a fork of TavernAI, it has evolved into the de-facto power-user interface for character-driven roleplay, collaborative fiction, and long-form conversational writing. It runs locally (Node.js) or in Docker and connects out to whichever backend you point it at: OpenAI, Anthropic Claude, Google Gemini, Mistral, OpenRouter, KoboldAI/KoboldCpp, Text-Generation-WebUI (Ooba), Tabby, llama.cpp, NovelAI, AI Horde, and any OpenAI-compatible endpoint. Because it is only a UI, no data flows through a SillyTavern-owned server — your prompts and chat history stay on your machine.

The app's real value is the density of controls it exposes over the raw prompt. You get fine-grained sampler settings, prompt manager with drag-and-drop ordering, author's notes, world info (lorebooks) that inject context on keyword triggers, character cards (V2/V3 spec) with example dialogue and personality fields, user personas, group chats with turn management, chat branching, swipes/regenerates, and a QuickReply/STscript scripting engine for macros and slash commands. RAG-style document ingestion, vector storage, and web-search extensions ship as first-party plugins. Extras add TTS (ElevenLabs, XTTS, Silero, OpenAI TTS), image generation (SD-WebUI, ComfyUI, Novita, OpenAI, Stability), speech-to-text, translation, and expression sprites for characters.

Typical workflows: running uncensored local models against a rich character card, orchestrating multi-character group scenes, building interactive fiction with lorebook triggers, or using it as a general chat client that beats vendor UIs on prompt control. The learning curve is real — the settings panels are dense and terminology assumes familiarity with samplers, context templates, and instruct formats — but for hobbyists who want to see and edit every token that goes to the model, nothing else in the ecosystem comes close.

Editor's take

If you've outgrown the vendor chat UIs and want to actually see the prompt that hits the model, SillyTavern is the endgame. It is not pretty by default and the settings sprawl is intimidating, but no other free tool combines this many backends with this much prompt-level control. Treat it as a power tool, not a consumer app.

— The AI Tool Bible editorial team

Pros

  • Backend-agnostic: works with virtually any commercial API and every popular local runner (Kobold, Ooba, Tabby, llama.cpp, OpenAI-compatible)
  • Runs locally so chat logs, character cards, and API keys never leave your machine
  • Deep prompt control — sampler settings, prompt manager ordering, instruct/context templates, author's notes
  • Mature ecosystem of character cards, world info/lorebooks, and community extensions
  • Group chats, chat branching, swipes, and QuickReply/STscript scripting for power workflows
  • Built-in RAG (data bank + vector storage) plus TTS, STT, and image-gen integrations
  • Completely free and open source under AGPL-3.0 with 300+ contributors and rapid release cadence

Cons

  • ⚠️ Steep learning curve — the UI is dense and assumes knowledge of samplers, instruct formats, and context templates
  • ⚠️ Requires local installation (Node.js or Docker); no hosted SaaS version officially exists
  • ⚠️ Primarily aimed at roleplay/creative-writing use cases; overkill as a plain assistant chat client
  • ⚠️ You still need to bring (and pay for, if commercial) your own model backend
  • ⚠️ Extension quality varies and some integrations (image-gen, TTS) require separate services running alongside

Use cases

Character-driven AI roleplayLong-form collaborative fictionLocal uncensored LLM chatMulti-character group scenesInteractive fiction with lorebook triggersPrompt engineering and sampler tuningPrivate frontend for OpenAI/Claude/Gemini APIsRAG over personal documentsVoice-enabled chat via TTS/STT extensions

Explore related

Compare with similar tools

All in Writing