Ollama alternatives
6 coding tools in the same lane as Ollama, ranked by editorial score.
LS
LM Studio
Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)
8.3
Desktop app for discovering, downloading, and running open-weight LLMs locally with an OpenAI-compatible server.
Freemium· Free: $0local-llm-inferenceprivate-chat
LB
LLM by Datasette
Coding · Multi-model
7.2
A CLI and Python library for running prompts against any LLM provider and logging everything to SQLite.
Free· Free and open source (Apache 2.0); pay underlying model providers separatelycli-promptingprompt-logging
OM
oMLX
Coding · Multi-model (Qwen, Llama, Mistral, Gemma, DeepSeek, MiniMax, GLM)
7.5
Native macOS LLM inference server built on MLX, with paged SSD KV caching for Apple Silicon agents.
Free· Free, Apache 2.0 open sourcelocal-llm-inferencecoding-agents
OP
OpenRouter
Coding · Multi-model
7.3
Unified API gateway to 400+ LLMs from 70+ providers, with one OpenAI-compatible endpoint and automatic failover.
Freemium· Pay-as-you-go credits; sample packs $10 and $99; some free-tier models availablellm-routingmulti-model-access
AS
AI SDK
Coding · Multi-model
7.2
Vercel's open-source TypeScript framework for building AI apps across 16+ providers with unified streaming, tools, and UI hooks.
Free· Open source (Apache 2.0); pay only for the underlying model APIschat-uiagent-building
GR
Groq
Coding · Multi-model (Llama, Mixtral, Gemma, Qwen, Whisper)
7.1
Custom-silicon LPU inference platform serving open models at GPU-trouncing latency via an OpenAI-compatible API.
Freemium· Free API key with rate limits; per-token paid tiers; enterprise contractslow-latency inferencevoice agents