Self-hosted AI tools
Editorial picks for "self hosted ai".
48 tools
Flux
FeaturedBlack Forest Labs' open-weights image model — rivals Midjourney quality.
LangGraph
FeaturedAgent Orchestration Framework for Reliable AI Agents
LlamaIndex
FeaturedData framework for connecting LLMs to your data.
CrewAI
FeaturedThe Enterprise Agent Build & Runtime for the work your business runs on
Stable Diffusion
Enterprise-ready creative partner delivering professional-grade generative AI tools for content production at scale.
Cline
Open-source agentic coding assistant that plans, edits, and runs code inside your IDE
Elasticsearch Vector Search
Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine
Whisper
Whisper is an automatic speech recognition system trained on 680,000 hours of multilingual and multitask supervised data.
Quivr
Quivr helps users build a second brain using Generative AI to act as a personal assistant.
Weaviate
Open-source AI-native vector database supporting hybrid search, multi-tenancy, and RAG.
ClearML
End-to-end platform for streamlining AI development and deployment.
Flyte
Flyte 2 is a durable AI runtime for running training, serving, and agent workloads with automatic recovery from failures.
Helicone
AI Gateway and LLM Observability platform
LangChain
The broad LLM application framework — chains, agents, retrievers.
Llama
Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.
Llama 3
Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.
LM Studio
LM Studio Bionic is a natively local agent for open models built for creativity, work, and code.
n8n
Workflow automation platform combining AI capabilities with business process automation, offering code flexibility and no-code speed.
Vanna.ai
Vanna 2.0 is a user-aware AI agent framework that connects LLMs to your database.
vLLM
Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.
AudioCraft
AudioCraft is a code base for generative audio needs including music, sound effects, and compression.
BentoML
Open-source framework and managed platform for serving and scaling AI models in production.
Browser Use
Cloud browser infrastructure and hosted agents for AI automation, with stealth browsers available at $0.02 per hour.
Feast
Feast is an open source feature store that delivers structured data to AI and LLM applications at high scale during training and inference.
Great Expectations
Open source framework for testing, validating, and documenting data quality across modern data pipelines, workflows, and teams.
Hermes Agent
Open-source, self-hosted AI agent with persistent memory, autonomous skill creation, and a messaging gateway for Telegram, Discord, Slack, WhatsApp, Signal, and email.
Jan
Open-source desktop ChatGPT alternative that runs local LLMs and connects to cloud models.
LanceDB
Open-source multimodal lakehouse and vector database built for AI training and retrieval at petabyte scale.
LibreChat
LibreChat brings together all AI conversations in one unified, customizable interface.
Ludwig
Open-source declarative deep learning framework for building, fine-tuning, and deploying custom models across tabular, text, image, and audio data without writing training loops.
Msty
SGLang
Open-source inference framework for large language, vision-language, and diffusion models optimized for agentic workloads and large-scale serving.
Sim
Open-source AI workspace for building, deploying, and managing AI agents.
Unsloth
Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.
Vespa
Yahoo's open-source search engine with vector + sparse retrieval.
Chroma
Open-source search infrastructure for AI
Cube
Cube is an agentic analytics platform built on a semantic layer for AI-native business intelligence and embedded analytics.
Langflow
Low-code AI builder for agentic and retrieval-augmented generation (RAG) applications.
LocalAI
LocalAI runs open models on the user's own hardware.
Mastra
Open-source TypeScript framework for building AI-powered applications and agents.
MLflow
Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.
Optuna
An automatic hyperparameter optimization software framework designed for machine learning.
PyGPT
Open-source desktop AI assistant for Windows, Linux and macOS with agents, RAG, Python tools, MCP, vision, image/video generation and Ollama.
RAGFlow
Open-source RAG engine combining retrieval and agent capabilities to create a context layer for LLMs.
Ray Tune
Python library for experiment execution and hyperparameter tuning at any scale.
Repomix
Repomix packages an entire codebase into a single AI-friendly file.
Genmo
Open-source text-to-video model (Mochi 1) with a hosted playground for turning prompts into short clips.
OpenHands
OpenHands is an AI agent platform for software development that executes real engineering work.