Skip to main content
📖 The AI Tool Bible

AI LLM deployment

Editorial picks for "deploy llm".

48 tools

All Fine-tuning →
TA

Together AI

Featured
Fine-tuning · Llama / Mistral / Qwen / DeepSeek and others
8.6

Fine-tune & serve open-weight models (Llama, Mistral, DeepSeek).

Paid· Pay-per-token; fine-tuning per-tokenopen modelsfine-tuning
MO

Modal

Fine-tuning · Infrastructure (any model you can host)
8.7

Serverless GPUs and infra for training & serving ML.

Freemium· $30/mo free credits; pay-as-you-go GPU ratesserverless GPUfine-tuning
AB

AWS Bedrock

Agents · Multi-model: Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Amazon Nova/Titan, DeepSeek, Stability, OpenAI GPT
8.6

Build and scale generative AI applications with foundation models

Paid· Standard: Contact sales · Flex: Contact sales · Priority: Contact sales · Reserved: Contact salesEnterprise RAG chatbot over private documentsMulti-step tool-using agents via AgentCore
GV

Google Vertex AI

Agents · Gemini 2.5 (Pro/Flash/Nano), Imagen, Veo, Chirp, plus Model Garden (Llama, Mistral, Claude via partner)
8.6

Google Cloud's unified platform for building, deploying, and scaling enterprise AI agents and models.

Paid· Image Data - Training (Classification): $3.465 / 1 hour · Image Data - Training (Object Detection): $3.465 / 1 hour · Image Data - Deployment and Online Prediction: $1.375 / 1 hour · Image Data - Batch Prediction: $2.222 / 1 hour · Tabular Data - Training (Classification/Regression): $21.252 / 1 hourEnterprise RAG chatbotMulti-agent customer service
IW

IBM watsonx

Agents · IBM Granite (3.x, Code, Time Series), Meta Llama 3.x, Mistral, plus other curated open models
8.6

Portfolio of AI products for building AI applications, managing trusted data, and governing AI.

EnterpriseManaging and integrating trusted dataAutomating AI governance and regulatory compliance
RE

Replicate

Fine-tuning · Thousands of community + first-party models
8.5

One-API platform for running and fine-tuning open-source models.

Paid· Pay-per-second of GPU timemodel hostingfine-tuning
CL

ClearML

Agents · Model-agnostic
8.3

End-to-end platform for streamlining AI development and deployment.

Freemium· Community plan is $0; Pro plan is $15 per user/month plus usageExperiment trackingDataset versioning
DA

Dataiku

Agents · Multi-model (LLM Mesh: OpenAI, Anthropic, Bedrock, Vertex, OSS)
8.3

Dataiku is a platform for AI success that unites people, orchestration, and governance to turn AI investments into measurable business outcomes.

EnterpriseAI agent design and deploymentData preparation and analytics
HA

H2O.ai

Agents · Multi-model
8.3

Enterprise AI platform combining AutoML, generative AI, and vertical agents for regulated industries.

Enterprise· Contact sales; live demo on requestenterprise-agentsautoml
LL

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1
8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Freemiumself-hosted-llmfine-tuning
LS

LM Studio

Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)
8.3

LM Studio Bionic is a natively local agent for open models built for creativity, work, and code.

Freemium· Free plan at $0; Bionic+ plan at $20 USD / month; Pro plan at $100 USD / monthCoding tasks and automationsReal-time voice transcription
RU

RunPod

Fine-tuning · Bring-your-own (any open-weight or custom model)
8.3

Paid· Pod H100 SXM: $4.39/hr; Pod RTX 4090: $0.89/hr; Serverless 80 GB H100 PRO: $5.89/hr; Serverless 24 GB 4090 PRO: $1.34/hr; Cluster H100 SXM: $4.79/GPU/hrModel training and fine-tuningServerless inference deployment
VL

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
BE

BentoML

Agents · Multi-model
8.2

Open-source framework and managed platform for serving and scaling AI models in production.

Freemium· OSS free (Apache 2.0); managed Bento cloud has free tier + usage-based pricingmodel-servingllm-inference
CO

CoreWeave

Fine-tuning · DeepSeek
8.2

An AI cloud platform purpose-built to turn complex AI workloads into discovery and creation.

Enterprise· Free tier · from $0.015/moAI model trainingAI inference
DA

Daytona

Agents
8.2

Secure and elastic infrastructure for running AI-generated code.

Freemium· Compute vCPU is $0.0504/h; Memory is $0.0162/h per GiB; Storage is $0.000108/h per GiB after the first 5 GiB are free; Windows OS is $0.0858/vCPU/h; $200 in free compute is includedAI evaluationsCode interpreter
OP

OpenPipe

Fine-tuning · Llama, Mistral, Qwen and other open-weight base models
8.2

Fine-tuning and reinforcement learning platform for turning expensive prompts into cheap, fast, task-specific models.

Freemium· Free tier available; usage-based pricing for training and hosted inference; enterprise plans on requestllm-cost-reductionfine-tuning
SG

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2

Open-source inference framework for large language, vision-language, and diffusion models optimized for agentic workloads and large-scale serving.

FreeAgentic workloadsLarge-scale serving
UN

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
LA

Lambda

Fine-tuning · NVIDIA VR200 NVL72, NVIDIA GB300 NVL72, NVIDIA HGX B200, NVIDIA HGX B300, NVIDIA H100
8.1

Supercomputers for training and inference

Paid· NVIDIA HGX B200 1-Click Cluster (16 GPUs, 2 weeks – 1 year) is $9.86 per GPU per hour; NVIDIA H100 1-Click Cluster (16 GPUs, 2 weeks – 1 year) is $6.16 per GPU per hour; NVIDIA HGX B200 Instance (8x, 180 GB VRAM) is $7.69 per GPU per hour; NVIDIA HGX H100 Instance (8x, 80 GB VRAM) is $4.59 per GPU per hour; NVIDIA HGX A100 Instance (8x, 80 GB VRAM) is $3.19 per GPU per hour; NVIDIA HGX A100 Instance (8x, 40 GB VRAM) is $1.99 per GPU per hour; NVIDIA Tesla V100 Instance (8x, 16 GB VRAM) is $0.79 per GPU per hourTraining and inferenceTraining foundation models
LO

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)
8.1

LocalAI runs open models on the user's own hardware.

FreeChatting with open models on local hardwareRunning Python scripts on data files
TA

Together AI Fine-tuning

Fine-tuning · Multi-model (any Hugging Face open-source model)
8.1

Managed fine-tuning for open-source models to improve accuracy and control behavior without managing infrastructure.

Paid· Usage-based; cost estimator in-product, no public price listllm-fine-tuningvision-fine-tuning
MI

MiniMax

Agents · MiniMax M3, Hailuo 2.3, Speech 2.8, Music 2.6
8.0

MiniMax develops a family of proprietary foundation models across text and multimodal capabilities.

Paid· speech-2.8-hd (Sync) costs $100 per million characters; image-01 costs $0.0035 per imagespeech synthesismusic generation
AN

Anyscale

Fine-tuning · Infrastructure (any model)
7.9

Anyscale helps AI builders run data-intensive workloads to build and deploy Foundation Models and AI at scale on any cloud, powered by Ray.

PaidMultimodal data curationDistributed model training
FA

Fireworks AI

Fine-tuning · Multi-model (DeepSeek, Qwen, GLM, Kimi, Gemma, Minimax, others)
7.9

A training and inference platform that transforms open models into specialized intelligence.

Paid· Serverless: From $0.05 / 1M input tokens; Managed Training: From $0.50 / 1M training tokens; Dedicated Training API: From $8.00 / GPU-hourOpen model inferenceModel training
DA

DataRobot

Agents · Multi-model
7.8

Unified Agent Workforce Platform for Enterprise

EnterpriseAgentic AIPredictive AI
MO

Modzy

Agents · Multi-model
7.7

Enterprise ModelOps platform for deploying and running AI/ML models across cloud, on-prem, and edge.

Enterprisemodel-deploymentedge-ai
OM

oMLX

Coding · Multi-model (Qwen, Llama, Mistral, Gemma, DeepSeek, MiniMax, GLM)
7.5

Native macOS LLM inference server built on MLX, with paged SSD KV caching for Apple Silicon agents.

Free· Free, Apache 2.0 open sourcelocal-llm-inferencecoding-agents
BI

Bifrost

Agents · Multi-model (OpenAI, Anthropic, Bedrock, Vertex, 1000+ via providers)
7.3

Open-source AI gateway that unifies 1000+ models behind one OpenAI-compatible endpoint with failover, budgets, and MCP routing.

Freemium· Free Forever: Free · Enterprise: Contact salesllm-gatewaymulti-provider-routing
FE

FedML

Fine-tuning · Bring-your-own (PyTorch, Hugging Face)
7.3

Distributed training, fine-tuning, and serving platform with federated learning roots.

Freemium· Open-source library free; managed GPU usage pay-as-you-gofine-tuningdistributed-training
KA

Kong AI Gateway

Agents · Multi-model
7.3

Kong AI Gateway governs LLM, MCP, and agent-to-agent traffic with a single gateway.

Paid· Plus plan from $25/month plus usage, billed monthlyLLM, MCP, and A2A traffic governancePII sanitization and data leakage prevention
KU

Kubeflow

Agents · Multi-framework (PyTorch, JAX, XGBoost, TensorFlow)
7.3

Kubeflow is the Cloud Native AI platform.

Freemachine learning workflowsLLM fine-tuning
PA

Pachyderm

Fine-tuning
7.3

Kubernetes-native data versioning and pipeline engine for reproducible ML at petabyte scale.

Freemiumdata-versioningml-pipelines
SE

Seldon

Agents · Multi-model (bring your own)
7.3

Kubernetes-native MLOps framework for real-time inference, observability, and compliance at scale.

Freemiumreal-time inferenceA/B testing and canary deployments
VA

Valohai

Agents · Multi-model
7.3

MLOps platform for versioned pipelines, distributed training, and LLM evaluation across any cloud.

Enterprise· Free trial; contact sales for pricingmlopsllm-evaluation
BE

Beam

Coding · openai/gpt-oss-20b
7.2

Serverless GPU infrastructure for AI workloads with sub-second cold starts and bring-your-own-cloud support.

Freemium· $30 free credit refreshed monthly; usage-based beyond thatgpu-inferenceagent-sandboxes
DD

Domino Data Lab

Agents · Multi-model
7.2

Enterprise AI platform for building, scaling, and governing AI-powered applications.

EnterpriseBuilding AI systems and applicationsClinical trial submissions
GE

Geniusrise

Agents · Multi-model
7.2

Open-source framework for building, deploying, and scaling AI microservices across text, vision, and audio.

Free· Free, open source; self-hostedinference-servingfine-tuning
OL

Ollama

Coding · Multi-model (Llama, Qwen, Gemma, DeepSeek, Mistral, Phi, etc.)
7.2

The de facto runtime for running open-weights LLMs locally, now with a paid cloud tier for bigger models.

Freemium· Free tier · from $20/molocal-llmself-hosted-inference
PG

Paperspace Gradient

Fine-tuning · Bring-your-own (PyTorch, TensorFlow, Hugging Face)
7.2

MLOps platform for building and scaling AI projects on DigitalOcean.

Freemium· Free tier · from $8/moexploring libraries and datasetstraining and fine-tuning models
WA

Wallaroo.AI

Agents · Multi-model
7.2

Production AI inference platform for deploying and monitoring models across cloud, on-prem, and edge.

Enterprise· Starter: $500 · Wallaroo Community Edition: Free · Ampere Community Edition: Freemodel-deploymentmlops
GR

Groq

Coding · Multi-model (Llama, Mixtral, Gemma, Qwen, Whisper)
7.1

Groq is a neocloud platform for fast inference.

Freemiumlarge-scale inferenceproduction-ready inference
IG

Iguazio

Agents · Multi-model
7.1

Enterprise MLOps and GenAI platform for taking models from notebook to production at scale.

Enterprise· Contact sales; free trial availablemlopsllm-fine-tuning
NR

Neu.ro

Agents · Multi-model
7.1

Infrastructure-agnostic MLOps platform for the full ML/DL lifecycle across public, hybrid, and on-prem clouds.

Enterprise· Contact sales; no public pricingmlopsmodel-training
SG

Scale GenAI Platform

Fine-tuning · Multi-model (OpenAI, Google, Meta, Mistral)
7.1

Scale GenAI Platform provides tools to build, deploy, and improve agents that reason over enterprise data and scale reliably.

Enterprise· Contact sales; enterprise contracts onlyMulti-agent workflowsHuman feedback loops
AS

Amazon SageMaker

Agents · Multi-model
7.0

The next generation of Amazon SageMaker is the center for all your data, analytics, and AI.

FreemiumModel training and deploymentGenerative AI application development
FO

Forefront

Fine-tuning · Multi-model (Mistral-7B, Mixtral, Phi-2)
7.0

Fine-tune and serve open-source LLMs on your own data without managing GPUs.

Paidfine-tuningopen-source-llms
JS

Jina Serve

Agents · StableLM
7.0

Framework for building and scaling multimodal AI services and pipelines over gRPC, HTTP, and WebSockets.

FreemiumLLM serving with streamingEmbedding services