Skip to main content
📖 The AI Tool Bible

Self-hosted AI tools

Editorial picks for "self hosted ai".

48 tools

FL

Flux

Featured
Image Generation · Flux.1 [schnell / dev / pro]
9.0

Black Forest Labs' open-weights image model — rivals Midjourney quality.

Freemium· FLUX.2 [max]: $0.07 · FLUX.2 [pro]: $0.03 · FLUX.2 [klein] 9B: $0.015 · FLUX.2 [klein] 4B: $0.014 · FLUX.2 [flex]: $0.05open sourceself-hosted
LA

LangGraph

Featured
Agents · BYO (Claude / GPT / open)
8.8

Stateful, graph-based agent orchestration from LangChain.

Freemium· Developer: $0 / seat · Plus: $39 / seat · Enterprise: Custom pricingstateful agentshuman-in-loop
LL

LlamaIndex

Featured
RAG · BYO (Claude / GPT / open)
8.7

Data framework for connecting LLMs to your data.

Freemium· Free open-source; LlamaCloud paidRAGdata ingestion
CR

CrewAI

Featured
Agents · BYO (Claude / GPT / open)
8.4

Python framework for multi-agent orchestration.

Freemium· Basic: Free · Enterprise: Custommulti-agentorchestration
SD

Stable Diffusion

Image Generation · SD 3.5 / SDXL
8.8

Open-source image generation — run anywhere, fine-tune anything.

Free· Free open weights; optional Stability APIlocalfine-tuning
CL

Cline

Coding · Model-agnostic: Claude (Anthropic), GPT (OpenAI), Gemini (Google), DeepSeek, Grok, Mistral, Cerebras, plus local Ollama/LM Studio
8.7

Open-source agentic coding assistant that plans, edits, and runs code inside your IDE

Freemium· ClinePass: $9.99/monthMulti-file feature scaffoldingLarge-scale refactors
EV

Elasticsearch Vector Search

RAG · BYO embeddings (OpenAI, Cohere, Hugging Face, Mistral, Bedrock, Vertex, Azure) plus Elastic's built-in ELSER sparse model and E5 dense model
8.7

Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine

Freemium· Resource based pricing: Pay as you go (monthly) or prepaid · Usage based pricing: Pay as you go (monthly) or prepaid · License based pricing: ?RAG chatbot over enterprise docsHybrid semantic + keyword product search
WH

Whisper

Audio · Whisper large-v3
8.6

OpenAI's open-source speech-to-text — the de-facto baseline.

Free· Free open weights; $0.006/min via OpenAI APItranscriptionself-hosted
QU

Quivr

RAG · Multi-model (OpenAI, Anthropic, Mistral, Gemma)
8.4

Open-source RAG framework for building custom AI assistants over your own documents in a few lines of Python.

Free· Open source (pip install quivr-core); pay only for LLM/vector-store usagedocument-qacustom-knowledge-base
WE

Weaviate

RAG · Hosted vector DB (not an LLM)
8.4

Open-source vector DB with hybrid search and modules.

Freemium· Free: $0 · Flex: $45 · Premium: $400self-hosted RAGhybrid search
CL

ClearML

Agents · Model-agnostic
8.3

End-to-end MLOps and GenAI platform with open-source experiment tracking and enterprise GPU orchestration.

Freemium· Community: $0 · Pro: $15 Per User/Month + Usage · Scale: Custom Quote · Enterprise: Request a Quoteexperiment-trackinggpu-orchestration
FL

Flyte

Agents · Multi-model
8.3

Open-source Python-native orchestration platform for AI, ML, and data workflows at production scale.

Freemium· OSS free; Union.ai commercial tier for enterpriseml-pipelinesagent-orchestration
HE

Helicone

Evaluation · Platform (any LLM)
8.3

Open-source LLM observability — one-line proxy install.

Freemium· Free 100k req/mo; Pro from $25/moobservabilitycost tracking
LA

LangChain

RAG · BYO (any major LLM)
8.3

The broad LLM application framework — chains, agents, retrievers.

Freemium· Free open-source; LangSmith paidgeneral LLM appsRAG
LL

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1
8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Freemium· Basic: $15 · Pro: $30 · Enterprise: $100self-hosted-llmfine-tuning
L3

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)
8.3

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Free· Weights free under Meta Llama Community License; inference cost via self-hosting or 3rd-party providerschatlong-context reasoning
LS

LM Studio

Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)
8.3

Desktop app for discovering, downloading, and running open-weight LLMs locally with an OpenAI-compatible server.

Freemium· Free: $0local-llm-inferenceprivate-chat
N8

n8n

Agents · Multi-model
8.3

Source-available workflow automation with first-class AI-agent and RAG building blocks.

Freemium· Starter: 20€ · Pro: 50€ · Business: 667€ · Enterprise: Contact Salesai-agentsworkflow-automation
VA

Vanna.ai

RAG · Multi-model (Anthropic, OpenAI, Gemini, Ollama)
8.3

Open-source text-to-SQL agent that learns your schema and writes queries against your real warehouse.

Freemium· Explorer: $50 · Team: $500 · Enterprise: Contact salestext-to-sqlnatural-language-bi
VL

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
AU

AudioCraft

Audio · MusicGen, AudioGen, EnCodec
8.2

Meta's open-source research toolkit for generating music and sound effects from text via a single autoregressive language model.

Free· Free and open source; self-hostedtext-to-musicsound-effects
BE

BentoML

Agents · Multi-model
8.2

Open-source framework and managed platform for serving and scaling AI models in production.

Freemium· OSS free (Apache 2.0); managed Bento cloud has free tier + usage-based pricingmodel-servingllm-inference
BU

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)
8.2

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Freemium· PAYG: $0 · Dev: $29 · Business: $299 · Scaleup: $999web-automationscraping
FE

Feast

RAG
8.2

Open-source feature store that serves consistent features to ML training and online inference, with RAG vector search built in.

Free· Free, open source (Apache 2.0); self-hostedfeature-storerag-retrieval
GE

Great Expectations

Evaluation
8.2

Open-source data quality framework for validating the datasets that feed your ML and analytics pipelines.

Freemium· Developer: Free · Team: Custom · Enterprise: Contact Salesdata-validationpipeline-testing
HA

Hermes Agent

Agents · Multi-model (300+ via Nous Portal)
8.2

Open-source multi-channel AI agent with persistent memory, scheduling, and subagent delegation from Nous Research.

Freemium· MIT-licensed self-host free; managed Portal tiers Free/Plus/Super/Ultra with creditspersonal-assistanttask-automation
JA

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)
8.2

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

Free· Free and open source; bring-your-own keys for cloud modelslocal-llm-chatprivate-ai-assistant
LA

LanceDB

RAG
8.2

Open-source multimodal lakehouse and vector database built for AI training and retrieval at petabyte scale.

Freemium· Open-source free; LanceDB Cloud and Enterprise via contact salesvector-searchrag
LI

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)
8.2

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Free· Free and open source; self-hosted (you pay model providers for API usage)multi-model chatself-hosted chatgpt
LU

Ludwig

Fine-tuning · Multi-model (PyTorch + HuggingFace Transformers)
8.2

Declarative, YAML-driven deep learning framework for fine-tuning LLMs and multi-modal models without writing training loops.

Free· Free, Apache 2.0 open sourcellm-fine-tuningmulti-modal-training
MS

Msty

Writing · Multi-model (Ollama, Claude, GPT, Gemini, others)
8.2

Privacy-first desktop AI workspace that runs local and cloud models side by side.

Freemium· Free: $0 · Aurum: ? · Aurum Lifetime: ? · Enterprise & Teams: Talk to uslocal-llm-chatmulti-model-comparison
SG

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2

Open-source high-throughput inference engine for LLMs and multimodal models with OpenAI-compatible serving.

Free· Free, open-source (Apache 2.0); self-hosted infra cost onlyllm-servingmultimodal-inference
SI

Sim

Agents · Multi-model (Claude, OpenAI, Google)
8.2

Open-source visual workspace for building, deploying, and monitoring AI agents.

Freemium· Free: $0 · Pro: $25 · Max: $100 · Enterprise: Customagent-workflowsinternal-automation
UN

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
VE

Vespa

RAG · Hosted search engine (not an LLM)
8.2

Yahoo's open-source search engine with vector + sparse retrieval.

Freemium· Free open-source; Vespa Cloud paidlarge-scale searchranking
CH

Chroma

RAG · Hosted vector DB (not an LLM)
8.1

Embedded, developer-friendly vector store for Python.

Freemium· Starter: $0 · Team: $250 · Enterprise: Customprototypingembedded RAG
CU

Cube

RAG · Multi-model
8.1

Semantic layer that grounds LLM agents in your real business metrics instead of letting them hallucinate SQL.

Freemium· Cube Core open source; Cube Cloud paid, contact salessemantic-layerembedded-analytics
LA

Langflow

Agents · Multi-model
8.1

Open-source visual builder for LangChain-style AI agents and RAG pipelines.

Freemium· Open-source free; hosted free tier + paid enterprise via DataStaxagent-prototypingrag-pipelines
LO

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)
8.1

Self-hosted OpenAI-compatible API for running LLMs, image, and audio models on your own hardware.

Free· Free and open source (MIT)local-llm-inferenceopenai-api-replacement
MA

Mastra

Agents · Multi-model (90+ providers)
8.1

Open-source TypeScript framework for building, deploying, and observing AI agents and workflows.

Freemium· Starter: $0 · Teams: $250 · Enterprise: Custom pricingai-agentsworkflow-orchestration
ML

MLflow

Evaluation · Multi-model
8.1

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Free· Free and open source (Apache 2.0); managed offering via Databricksllm-evaluationexperiment-tracking
OP

Optuna

Fine-tuning
8.1

Open-source Python framework for automated hyperparameter optimization across any ML stack.

Free· Free and open source (MIT)hyperparameter-tuningml-experiment-tracking
PY

PyGPT

Writing · Multi-model (GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Ollama)
8.1

Open-source desktop AI assistant that wires every major LLM provider into one local app with agents, vision, and a code interpreter.

Free· Free and open-source (MIT); bring your own provider API keysdesktop-ai-assistantchat-with-files
RA

RAGFlow

RAG · Multi-model
8.1

Open-source RAG engine with deep document parsing, hybrid search, and visual agent orchestration.

Freemium· Free tier; Starter $29/mo; Pro $129/mo; Enterprise customdocument-qaenterprise-search
RT

Ray Tune

Fine-tuning
8.1

Open-source Python library for distributed hyperparameter tuning at any scale.

Free· Open-source (Apache 2.0); managed via Anyscale offers a $100 starting credithyperparameter-tuningdistributed-training
RE

Repomix

Coding · ChatGPT, Claude, Gemini, Grok
8.1

Packs an entire codebase into a single AI-friendly file so LLMs can actually read your repo.

Free· Free and open source (MIT)codebase-to-llmcode-review
GE

Genmo

Video · Mochi 1
8.0

Open-source text-to-video model (Mochi 1) with a hosted playground for turning prompts into short clips.

Freemium· Free: $0/month · Lite: Loading... · Standard: Loading...text-to-videogenerative-video
OP

OpenHands

Agents · Multi-model (Claude, Gemini, GPT/Codex)
8.0

Open-source autonomous coding agent that plans, edits, and ships changes across real codebases.

Freemium· Open Source: Free · Individual: Free · Enterprise: Custom pricingautonomous-codingpr-review