Skip to main content
📖 The AI Tool Bible

AI tools tagged Self Hostable

48 tools matching this tag.tech

All tags →
FL

Flux

Featured
Image Generation · Flux.1 [schnell / dev / pro]
9.0

Black Forest Labs' open-weights image model — rivals Midjourney quality.

Freemium· FLUX.2 [max]: $0.07 · FLUX.2 [pro]: $0.03 · FLUX.2 [klein] 9B: $0.015 · FLUX.2 [klein] 4B: $0.014 · FLUX.2 [flex]: $0.05open sourceself-hosted
SD

Stable Diffusion

Image Generation · SD 3.5 / SDXL
8.8

Open-source image generation — run anywhere, fine-tune anything.

Free· Free open weights; optional Stability APIlocalfine-tuning
EV

Elasticsearch Vector Search

RAG · BYO embeddings (OpenAI, Cohere, Hugging Face, Mistral, Bedrock, Vertex, Azure) plus Elastic's built-in ELSER sparse model and E5 dense model
8.7

Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine

Freemium· Resource based pricing: Pay as you go (monthly) or prepaid · Usage based pricing: Pay as you go (monthly) or prepaid · License based pricing: ?RAG chatbot over enterprise docsHybrid semantic + keyword product search
WH

Whisper

Audio · Whisper large-v3
8.6

OpenAI's open-source speech-to-text — the de-facto baseline.

Free· Free open weights; $0.006/min via OpenAI APItranscriptionself-hosted
QU

Quivr

RAG · Multi-model (OpenAI, Anthropic, Mistral, Gemma)
8.4

Open-source RAG framework for building custom AI assistants over your own documents in a few lines of Python.

Free· Open source (pip install quivr-core); pay only for LLM/vector-store usagedocument-qacustom-knowledge-base
SC

ScrapeGraphAI

Agents · Multi-model (LLM, unspecified)
8.4

LLM-driven web scraping API that turns natural-language prompts into structured JSON.

Freemium· Free 500 credits; Starter $20/mo, Growth $100/mo, Pro $500/mo, Enterprise customweb-scrapingdata-extraction
WE

Weaviate

RAG · Hosted vector DB (not an LLM)
8.4

Open-source vector DB with hybrid search and modules.

Freemium· Free: $0 · Flex: $45 · Premium: $400self-hosted RAGhybrid search
CL

ClearML

Agents · Model-agnostic
8.3

End-to-end MLOps and GenAI platform with open-source experiment tracking and enterprise GPU orchestration.

Freemium· Community: $0 · Pro: $15 Per User/Month + Usage · Scale: Custom Quote · Enterprise: Request a Quoteexperiment-trackinggpu-orchestration
FL

Flyte

Agents · Multi-model
8.3

Open-source Python-native orchestration platform for AI, ML, and data workflows at production scale.

Freemium· OSS free; Union.ai commercial tier for enterpriseml-pipelinesagent-orchestration
HA

H2O.ai

Agents · Multi-model
8.3

Enterprise AI platform combining AutoML, generative AI, and vertical agents for regulated industries.

Enterprise· Contact sales; live demo on requestenterprise-agentsautoml
HE

Helicone

Evaluation · Platform (any LLM)
8.3

Open-source LLM observability — one-line proxy install.

Freemium· Free 100k req/mo; Pro from $25/moobservabilitycost tracking
LL

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1
8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Freemium· Basic: $15 · Pro: $30 · Enterprise: $100self-hosted-llmfine-tuning
N8

n8n

Agents · Multi-model
8.3

Source-available workflow automation with first-class AI-agent and RAG building blocks.

Freemium· Starter: 20€ · Pro: 50€ · Business: 667€ · Enterprise: Contact Salesai-agentsworkflow-automation
SK

Skyvern

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)
8.3

AI browser agent that automates web workflows from natural-language instructions, with CAPTCHA and 2FA handling built in.

Freemium· Free: $0/month · Hobby: $29/month · Pro: $149/month · Enterprise: Custom/monthbrowser-automationdata-extraction
VA

Vanna.ai

RAG · Multi-model (Anthropic, OpenAI, Gemini, Ollama)
8.3

Open-source text-to-SQL agent that learns your schema and writes queries against your real warehouse.

Freemium· Explorer: $50 · Team: $500 · Enterprise: Contact salestext-to-sqlnatural-language-bi
VL

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
AU

AudioCraft

Audio · MusicGen, AudioGen, EnCodec
8.2

Meta's open-source research toolkit for generating music and sound effects from text via a single autoregressive language model.

Free· Free and open source; self-hostedtext-to-musicsound-effects
BE

BentoML

Agents · Multi-model
8.2

Open-source framework and managed platform for serving and scaling AI models in production.

Freemium· OSS free (Apache 2.0); managed Bento cloud has free tier + usage-based pricingmodel-servingllm-inference
BU

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)
8.2

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Freemium· PAYG: $0 · Dev: $29 · Business: $299 · Scaleup: $999web-automationscraping
FE

Feast

RAG
8.2

Open-source feature store that serves consistent features to ML training and online inference, with RAG vector search built in.

Free· Free, open source (Apache 2.0); self-hostedfeature-storerag-retrieval
GI

Giskard

Evaluation · Multi-model
8.2

Continuous AI red teaming platform that stress-tests LLM agents for vulnerabilities before they hit production.

Freemium· Open-source free tier; Giskard Hub enterprise pricing on requestllm-red-teamingagent-security-testing
GE

Great Expectations

Evaluation
8.2

Open-source data quality framework for validating the datasets that feed your ML and analytics pipelines.

Freemium· Developer: Free · Team: Custom · Enterprise: Contact Salesdata-validationpipeline-testing
HA

Hermes Agent

Agents · Multi-model (300+ via Nous Portal)
8.2

Open-source multi-channel AI agent with persistent memory, scheduling, and subagent delegation from Nous Research.

Freemium· MIT-licensed self-host free; managed Portal tiers Free/Plus/Super/Ultra with creditspersonal-assistanttask-automation
HY

HyperFrames

Video · Multi-model (Claude Code skill; BYO agent)
8.2

Open-source video composition framework that lets AI agents build videos by writing HTML, CSS, and JS.

Free· Free, open-source (Apache 2.0)agent-driven videoprogrammatic video
LA

LanceDB

RAG
8.2

Open-source multimodal lakehouse and vector database built for AI training and retrieval at petabyte scale.

Freemium· Open-source free; LanceDB Cloud and Enterprise via contact salesvector-searchrag
LI

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)
8.2

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Free· Free and open source; self-hosted (you pay model providers for API usage)multi-model chatself-hosted chatgpt
LU

Ludwig

Fine-tuning · Multi-model (PyTorch + HuggingFace Transformers)
8.2

Declarative, YAML-driven deep learning framework for fine-tuning LLMs and multi-modal models without writing training loops.

Free· Free, Apache 2.0 open sourcellm-fine-tuningmulti-modal-training
SG

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2

Open-source high-throughput inference engine for LLMs and multimodal models with OpenAI-compatible serving.

Free· Free, open-source (Apache 2.0); self-hosted infra cost onlyllm-servingmultimodal-inference
SI

Sim

Agents · Multi-model (Claude, OpenAI, Google)
8.2

Open-source visual workspace for building, deploying, and monitoring AI agents.

Freemium· Free: $0 · Pro: $25 · Max: $100 · Enterprise: Customagent-workflowsinternal-automation
UN

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
VE

Vespa

RAG · Hosted search engine (not an LLM)
8.2

Yahoo's open-source search engine with vector + sparse retrieval.

Freemium· Free open-source; Vespa Cloud paidlarge-scale searchranking
CH

Chroma

RAG · Hosted vector DB (not an LLM)
8.1

Embedded, developer-friendly vector store for Python.

Freemium· Starter: $0 · Team: $250 · Enterprise: Customprototypingembedded RAG
CU

Cube

RAG · Multi-model
8.1

Semantic layer that grounds LLM agents in your real business metrics instead of letting them hallucinate SQL.

Freemium· Cube Core open source; Cube Cloud paid, contact salessemantic-layerembedded-analytics
LA

Langflow

Agents · Multi-model
8.1

Open-source visual builder for LangChain-style AI agents and RAG pipelines.

Freemium· Open-source free; hosted free tier + paid enterprise via DataStaxagent-prototypingrag-pipelines
LO

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)
8.1

Self-hosted OpenAI-compatible API for running LLMs, image, and audio models on your own hardware.

Free· Free and open source (MIT)local-llm-inferenceopenai-api-replacement
MA

Mastra

Agents · Multi-model (90+ providers)
8.1

Open-source TypeScript framework for building, deploying, and observing AI agents and workflows.

Freemium· Starter: $0 · Teams: $250 · Enterprise: Custom pricingai-agentsworkflow-orchestration
ML

MLflow

Evaluation · Multi-model
8.1

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Free· Free and open source (Apache 2.0); managed offering via Databricksllm-evaluationexperiment-tracking
OP

Optuna

Fine-tuning
8.1

Open-source Python framework for automated hyperparameter optimization across any ML stack.

Free· Free and open source (MIT)hyperparameter-tuningml-experiment-tracking
PY

PyGPT

Writing · Multi-model (GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Ollama)
8.1

Open-source desktop AI assistant that wires every major LLM provider into one local app with agents, vision, and a code interpreter.

Free· Free and open-source (MIT); bring your own provider API keysdesktop-ai-assistantchat-with-files
RA

RAGFlow

RAG · Multi-model
8.1

Open-source RAG engine with deep document parsing, hybrid search, and visual agent orchestration.

Freemium· Free tier; Starter $29/mo; Pro $129/mo; Enterprise customdocument-qaenterprise-search
RT

Ray Tune

Fine-tuning
8.1

Open-source Python library for distributed hyperparameter tuning at any scale.

Free· Open-source (Apache 2.0); managed via Anyscale offers a $100 starting credithyperparameter-tuningdistributed-training
RE

Repomix

Coding · ChatGPT, Claude, Gemini, Grok
8.1

Packs an entire codebase into a single AI-friendly file so LLMs can actually read your repo.

Free· Free and open source (MIT)codebase-to-llmcode-review
TR

TruLens

Evaluation · Multi-model (LLM-as-judge)
8.1

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Free· Free, open source (Apache-licensed Python package)llm-evaluationrag-evaluation
GE

Genmo

Video · Mochi 1
8.0

Open-source text-to-video model (Mochi 1) with a hosted playground for turning prompts into short clips.

Freemium· Free: $0/month · Lite: Loading... · Standard: Loading...text-to-videogenerative-video
OP

OpenHands

Agents · Multi-model (Claude, Gemini, GPT/Codex)
8.0

Open-source autonomous coding agent that plans, edits, and ships changes across real codebases.

Freemium· Open Source: Free · Individual: Free · Enterprise: Custom pricingautonomous-codingpr-review
WA

Wren AI

RAG · Multi-model (OpenAI, Anthropic, Gemini, self-hosted)
8.0

Open-source GenBI semantic layer that lets AI agents query your warehouse in natural language with governed, accurate SQL.

Freemium· Free: $0 · Essential Cloud: $179 · Enterprise Cloud: $559 · Enterprise Plus: Contact Ustext-to-sqlsemantic-layer
AN

AnythingLLM

RAG · Multi-model
7.9

Open-source desktop and self-hosted app that turns your documents into a private chat-and-agent workspace.

Freemium· Basic: $50/monthly · Pro: $99/monthly · Enterprise: Contact Usdocument-chatprivate-rag
CO

Continue

Coding · BYO (any OpenAI-compatible API + Ollama for local)
7.9

Open-source, self-hostable VS Code/JetBrains AI assistant.

Free· Free / open-source; you pay model costsself-hostedopen source