vLLM alternatives
6 fine-tuning tools in the same lane as vLLM, ranked by editorial score.
SG
SGLang
Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2
Open-source high-throughput inference engine for LLMs and multimodal models with OpenAI-compatible serving.
Free· Free, open-source (Apache 2.0); self-hosted infra cost onlyllm-servingmultimodal-inference
FA
Fireworks AI
Fine-tuning · Multi-model (DeepSeek, Qwen, GLM, Kimi, Gemma, Minimax, others)
7.9
Production inference and fine-tuning platform for open-source LLMs, tuned for speed and enterprise economics.
Freemium· Free signup credits; pay-per-token from ~$0.14/M in; enterprise reserved capacity on requestllm-fine-tuningserverless-inference
RE
Replicate
Fine-tuning · Thousands of community + first-party models
8.5
One-API platform for running and fine-tuning open-source models.
Paid· Pay-per-second of GPU timemodel hostingfine-tuning
TA
Together AI
FeaturedFine-tuning · Llama / Mistral / Qwen / DeepSeek and others
8.6
Fine-tune & serve open-weight models (Llama, Mistral, DeepSeek).
Paid· Pay-per-token; fine-tuning per-tokenopen modelsfine-tuning
UN
Unsloth
Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2
Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.
Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
LF
LLaMA Factory
Fine-tuning · Multi-model (LLaMA, Mistral, Qwen, Gemma, Phi, LLaVA, ChatGLM, Yi)
7.2
Open-source, no-code WebUI for fine-tuning 100+ open LLMs with LoRA, QLoRA, DPO, and PPO.
Free· Free, open-source (Apache-2.0); self-hostedlora-fine-tuningqlora