Best AI tools for gpu infrastructure
20 tools in the Fine-tuning category, filtered to gpu infrastructure.
Together AI
FeaturedFine-tune & serve open-weight models (Llama, Mistral, DeepSeek).
Modal
Serverless GPUs and infra for training & serving ML.
Replicate
One-API platform for running and fine-tuning open-source models.
RunPod
vLLM
Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.
CoreWeave
An AI cloud platform purpose-built to turn complex AI workloads into discovery and creation.
SGLang
Open-source inference framework for large language, vision-language, and diffusion models optimized for agentic workloads and large-scale serving.
Lambda
Supercomputers for training and inference
Ray Tune
Python library for experiment execution and hyperparameter tuning at any scale.
Anyscale
Anyscale helps AI builders run data-intensive workloads to build and deploy Foundation Models and AI at scale on any cloud, powered by Ray.
Fireworks AI
A training and inference platform that transforms open models into specialized intelligence.
FedML
Distributed training, fine-tuning, and serving platform with federated learning roots.
Pachyderm
Kubernetes-native data versioning and pipeline engine for reproducible ML at petabyte scale.
Seldon
Kubernetes-native MLOps framework for real-time inference, observability, and compliance at scale.
Paperspace Gradient
MLOps platform for building and scaling AI projects on DigitalOcean.
Forefront
Fine-tune and serve open-source LLMs on your own data without managing GPUs.
Apache SINGA
Apache SINGA is an Apache Top Level Project focusing on distributed training of deep learning and machine learning models.
Velda
Serverless GPU Cloud without overhead of containers or cluster management.
Colossal-AI
Making big AI models cheaper, easier, and scalable
PyTorch Lightning
The deep learning framework for professional AI researchers and ML engineers