Optuna alternatives
6 fine-tuning tools in the same lane as Optuna, ranked by editorial score.
RT
Ray Tune
Fine-tuning
8.1
Open-source Python library for distributed hyperparameter tuning at any scale.
Free· Open-source (Apache 2.0); managed via Anyscale offers a $100 starting credithyperparameter-tuningdistributed-training
WB
W&B Sweeps
Fine-tuning · Multi-model (Llama, DeepSeek, Qwen, Kimi)
7.1
Hyperparameter optimization from Weights & Biases with Bayesian search and Hyperband early stopping.
Freemium· Free: $0/mo · Pro: $60/month, billed monthly · Enterprise: Custom plans · Personal: $0/mo · Advanced Enterprise: Custom planhyperparameter-tuningbayesian-optimization
UN
Unsloth
Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2
Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.
Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
LU
Ludwig
Fine-tuning · Multi-model (PyTorch + HuggingFace Transformers)
8.2
Declarative, YAML-driven deep learning framework for fine-tuning LLMs and multi-modal models without writing training loops.
Free· Free, Apache 2.0 open sourcellm-fine-tuningmulti-modal-training
LF
LLaMA Factory
Fine-tuning · Multi-model (LLaMA, Mistral, Qwen, Gemma, Phi, LLaVA, ChatGLM, Yi)
7.2
Open-source, no-code WebUI for fine-tuning 100+ open LLMs with LoRA, QLoRA, DPO, and PPO.
Free· Free, open-source (Apache-2.0); self-hostedlora-fine-tuningqlora
AU
AutotuneLLM
Fine-tuning
An open-source optimization layer that sits between your app and Ollama to squeeze more performance out of local LLMs.
Free· Free and open source (MIT licensed).Local LLM inference on Apple SiliconReducing KV cache RAM for Ollama models