Skip to main content
📖 The AI Tool Bible

Best AI tools for gpu infrastructure

20 tools in the Fine-tuning category, filtered to gpu infrastructure.

All Fine-tuning →
TA

Together AI

Featured
Fine-tuning · Llama / Mistral / Qwen / DeepSeek and others
8.6

Fine-tune & serve open-weight models (Llama, Mistral, DeepSeek).

Paid· Pay-per-token; fine-tuning per-tokenopen modelsfine-tuning
MO

Modal

Fine-tuning · Infrastructure (any model you can host)
8.7

Serverless GPUs and infra for training & serving ML.

Freemium· $30/mo free credits; pay-as-you-go GPU ratesserverless GPUfine-tuning
RE

Replicate

Fine-tuning · Thousands of community + first-party models
8.5

One-API platform for running and fine-tuning open-source models.

Paid· Pay-per-second of GPU timemodel hostingfine-tuning
RU

RunPod

Fine-tuning · Bring-your-own (any open-weight or custom model)
8.3

Paid· Pod H100 SXM: $4.39/hr; Pod RTX 4090: $0.89/hr; Serverless 80 GB H100 PRO: $5.89/hr; Serverless 24 GB 4090 PRO: $1.34/hr; Cluster H100 SXM: $4.79/GPU/hrModel training and fine-tuningServerless inference deployment
VL

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
CO

CoreWeave

Fine-tuning · DeepSeek
8.2

An AI cloud platform purpose-built to turn complex AI workloads into discovery and creation.

Enterprise· Free tier · from $0.015/moAI model trainingAI inference
SG

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2

Open-source inference framework for large language, vision-language, and diffusion models optimized for agentic workloads and large-scale serving.

FreeAgentic workloadsLarge-scale serving
LA

Lambda

Fine-tuning · NVIDIA VR200 NVL72, NVIDIA GB300 NVL72, NVIDIA HGX B200, NVIDIA HGX B300, NVIDIA H100
8.1

Supercomputers for training and inference

Paid· NVIDIA HGX B200 1-Click Cluster (16 GPUs, 2 weeks – 1 year) is $9.86 per GPU per hour; NVIDIA H100 1-Click Cluster (16 GPUs, 2 weeks – 1 year) is $6.16 per GPU per hour; NVIDIA HGX B200 Instance (8x, 180 GB VRAM) is $7.69 per GPU per hour; NVIDIA HGX H100 Instance (8x, 80 GB VRAM) is $4.59 per GPU per hour; NVIDIA HGX A100 Instance (8x, 80 GB VRAM) is $3.19 per GPU per hour; NVIDIA HGX A100 Instance (8x, 40 GB VRAM) is $1.99 per GPU per hour; NVIDIA Tesla V100 Instance (8x, 16 GB VRAM) is $0.79 per GPU per hourTraining and inferenceTraining foundation models
RT

Ray Tune

Fine-tuning
8.1

Python library for experiment execution and hyperparameter tuning at any scale.

Free· Open-source (Apache 2.0); managed via Anyscale offers a $100 starting credithyperparameter-tuningearly-stopping
AN

Anyscale

Fine-tuning · Infrastructure (any model)
7.9

Anyscale helps AI builders run data-intensive workloads to build and deploy Foundation Models and AI at scale on any cloud, powered by Ray.

PaidMultimodal data curationDistributed model training
FA

Fireworks AI

Fine-tuning · Multi-model (DeepSeek, Qwen, GLM, Kimi, Gemma, Minimax, others)
7.9

A training and inference platform that transforms open models into specialized intelligence.

Paid· Serverless: From $0.05 / 1M input tokens; Managed Training: From $0.50 / 1M training tokens; Dedicated Training API: From $8.00 / GPU-hourOpen model inferenceModel training
FE

FedML

Fine-tuning · Bring-your-own (PyTorch, Hugging Face)
7.3

Distributed training, fine-tuning, and serving platform with federated learning roots.

Freemium· Open-source library free; managed GPU usage pay-as-you-gofine-tuningdistributed-training
PA

Pachyderm

Fine-tuning
7.3

Kubernetes-native data versioning and pipeline engine for reproducible ML at petabyte scale.

Freemiumdata-versioningml-pipelines
SE

Seldon

Agents · Multi-model (bring your own)
7.3

Kubernetes-native MLOps framework for real-time inference, observability, and compliance at scale.

Freemiumreal-time inferenceA/B testing and canary deployments
PG

Paperspace Gradient

Fine-tuning · Bring-your-own (PyTorch, TensorFlow, Hugging Face)
7.2

MLOps platform for building and scaling AI projects on DigitalOcean.

Freemium· Free tier · from $8/moexploring libraries and datasetstraining and fine-tuning models
FO

Forefront

Fine-tuning · Multi-model (Mistral-7B, Mixtral, Phi-2)
7.0

Fine-tune and serve open-source LLMs on your own data without managing GPUs.

Paidfine-tuningopen-source-llms
AS

Apache SINGA

Fine-tuning
6.9

Apache SINGA is an Apache Top Level Project focusing on distributed training of deep learning and machine learning models.

Free· Free, Apache 2.0 licensedDistributed training of deep learning modelsHealthcare and science domain models
VE

Velda

Fine-tuning
6.7

Serverless GPU Cloud without overhead of containers or cluster management.

Freemium· Free plan; shell pool: $0.40 per hour for 4 vCPU, 16 GB RAMTraining and inference jobsServing and data pipelines
CA

Colossal-AI

Fine-tuning · Framework-agnostic; used with LLaMA, GPT, Stable Diffusion, ViT, and other PyTorch-based open-weight models

Making big AI models cheaper, easier, and scalable

FreeTraining GPT using hybrid parallelismTensor parallel micro-benchmarking
PL

PyTorch Lightning

Fine-tuning · Framework-agnostic — trains any PyTorch model (transformers, CNNs, diffusion, RL nets, etc.)

The deep learning framework for professional AI researchers and ML engineers

Free· Free and open source (Apache 2.0). Optional paid compute available via the Lightning AI Studio platform.Multi-GPU LLM fine-tuningComputer vision model training