AI private LLM hosting
Editorial picks for "private llm hosting".
48 tools
Together AI
FeaturedFine-tune & serve open-weight models (Llama, Mistral, DeepSeek).
Modal
Serverless GPUs and infra for training & serving ML.
AWS Bedrock
Build and scale generative AI applications with foundation models
Google Vertex AI
Google Cloud's unified platform for building, deploying, and scaling enterprise AI agents and models.
IBM watsonx
Portfolio of AI products for building AI applications, managing trusted data, and governing AI.
H2O.ai
Enterprise AI platform combining AutoML, generative AI, and vertical agents for regulated industries.
Llama
Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.
LM Studio
LM Studio Bionic is a natively local agent for open models built for creativity, work, and code.
RunPod
vLLM
Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.
BentoML
Open-source framework and managed platform for serving and scaling AI models in production.
CoreWeave
An AI cloud platform purpose-built to turn complex AI workloads into discovery and creation.
Daytona
Secure and elastic infrastructure for running AI-generated code.
SGLang
Open-source inference framework for large language, vision-language, and diffusion models optimized for agentic workloads and large-scale serving.
Lambda
Supercomputers for training and inference
LocalAI
LocalAI runs open models on the user's own hardware.
Together AI Fine-tuning
Managed fine-tuning for open-source models to improve accuracy and control behavior without managing infrastructure.
Anyscale
Anyscale helps AI builders run data-intensive workloads to build and deploy Foundation Models and AI at scale on any cloud, powered by Ray.
Fireworks AI
A training and inference platform that transforms open models into specialized intelligence.
Lamini
Memory-tuning platform for grounding LLMs in your facts.
Modzy
Enterprise ModelOps platform for deploying and running AI/ML models across cloud, on-prem, and edge.
oMLX
Native macOS LLM inference server built on MLX, with paged SSD KV caching for Apple Silicon agents.
FedML
Distributed training, fine-tuning, and serving platform with federated learning roots.
Seldon
Kubernetes-native MLOps framework for real-time inference, observability, and compliance at scale.
Valohai
MLOps platform for versioned pipelines, distributed training, and LLM evaluation across any cloud.
Beam
Serverless GPU infrastructure for AI workloads with sub-second cold starts and bring-your-own-cloud support.
Domino Data Lab
Enterprise AI platform for building, scaling, and governing AI-powered applications.
Geniusrise
Open-source framework for building, deploying, and scaling AI microservices across text, vision, and audio.
Ollama
The de facto runtime for running open-weights LLMs locally, now with a paid cloud tier for bigger models.
Paperspace Gradient
MLOps platform for building and scaling AI projects on DigitalOcean.
Wallaroo.AI
Production AI inference platform for deploying and monitoring models across cloud, on-prem, and edge.
Iguazio
Enterprise MLOps and GenAI platform for taking models from notebook to production at scale.
Neu.ro
Infrastructure-agnostic MLOps platform for the full ML/DL lifecycle across public, hybrid, and on-prem clouds.
Scale GenAI Platform
Scale GenAI Platform provides tools to build, deploy, and improve agents that reason over enterprise data and scale reliably.
Amazon SageMaker
The next generation of Amazon SageMaker is the center for all your data, analytics, and AI.
Forefront
Fine-tune and serve open-source LLMs on your own data without managing GPUs.
Jina Serve
Framework for building and scaling multimodal AI services and pipelines over gRPC, HTTP, and WebSockets.
OpenSandbox
OpenSandbox provides isolated environments for AI agents to execute code, use tools, and explore the web on user infrastructure.
PrivateGPT
Open-source API layer that turns local models into production AI applications.
Chassis
Open-source tool that auto-packages ML models into production-ready Docker containers with a prediction API.
Katonic AI
Full-stack enterprise platform for building, deploying, and governing AI agents on your own infrastructure.
TrueFoundry
Enterprise control plane for deploying, governing, and scaling agentic AI on your own infrastructure.
Prediction Guard
Self-hosted AI control plane that lets regulated enterprises govern models, agents, and MCP servers behind their firewall.
AutotuneLLM
An open-source optimization layer that sits between your app and Ollama to squeeze more performance out of local LLMs.
LLM Gateway
LLM GPU Checker (KO)
Match LLMs to GPUs and plan multi-model AI stacks by VRAM, bandwidth and precision.
Open WebUI
Self-hosted, extensible AI chat platform that runs on your infrastructure
QuantProbe
Interactive calculator predicting LLM decode speed and memory fit from the tiered decode law, with charts showing the speed-memory trade-off.