Skip to main content
📖 The AI Tool Bible

AI model distillation

Editorial picks for "llm distillation".

48 tools

All Fine-tuning
AWS Bedrock preview image
AWS Bedrock logo

AWS Bedrock

Agents · Multi-model: Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Amazon Nova/Titan, DeepSeek, Stability, OpenAI GPT
8.6

Build and scale generative AI applications with foundation models

Paid· Standard: Contact sales · Flex: Contact sales · Priority: Contact sales · Reserved: Contact salesEnterprise RAG chatbot over private documentsMulti-step tool-using agents via AgentCore
OpenPipe preview image
OpenPipe logo

OpenPipe

Fine-tuning · Llama, Mistral, Qwen and other open-weight base models
8.2

Fine-tuning and reinforcement learning platform for turning expensive prompts into cheap, fast, task-specific models.

Freemium· Free tier available; usage-based pricing for training and hosted inference; enterprise plans on requestllm-cost-reductionfine-tuning
Fabric preview image
Fabric logo

Fabric

Agents · Model-agnostic: OpenAI GPT-4o/GPT-4.1, Anthropic Claude (incl. Opus 4.7), Google Gemini, Azure OpenAI, Bedrock, Vertex AI, plus local Ollama and LM Studio models.

An open-source framework for augmenting humans with AI, one composable prompt at a time.

Free· Free and open-source (MIT). Users bring their own API keys and pay each LLM provider directly; local models via Ollama or LM Studio incur no per-token cost.YouTube video summarisation and wisdom extractionLong-form article and PDF summarisation
Mem0 preview image
Mem0 logo

Mem0

Agents · Model-agnostic — pluggable via OpenAI, Anthropic, Gemini, Ollama, LiteLLM (no in-house LLM)

Persistent memory layer for AI agents and LLM apps

Freemium· Hobby: Free · Starter: $19 · Pro: $249 · Enterprise: CustomLong-lived customer support copilotsPersonal AI companions and journaling agents
Warp preview image
Warp logo

Warp

Coding · Multi-model: OpenAI, Anthropic Claude, Amazon Bedrock, plus BYO via OpenRouter and LiteLLM
8.8

The agentic development environment, from the terminal up

Freemium· Free: $0/month · Build: $20/month · Max: $200/month · Business: $50/user /month · Enterprise: CustomAgentic debugging of failing builds and testsNatural-language shell command generation
Cline preview image
Cline logo

Cline

Coding · Model-agnostic: Claude (Anthropic), GPT (OpenAI), Gemini (Google), DeepSeek, Grok, Mistral, Cerebras, plus local Ollama/LM Studio
8.7

Open-source agentic coding assistant that plans, edits, and runs code inside your IDE

Freemium· ClinePass: $9.99/monthMulti-file feature scaffoldingLarge-scale refactors
Elasticsearch Vector Search preview image
Elasticsearch Vector Search logo

Elasticsearch Vector Search

RAG · BYO embeddings (OpenAI, Cohere, Hugging Face, Mistral, Bedrock, Vertex, Azure) plus Elastic's built-in ELSER sparse model and E5 dense model
8.7

Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine

Freemium· Resource based pricing: Pay as you go (monthly) or prepaid · Usage based pricing: Pay as you go (monthly) or prepaid · License based pricing: ?RAG chatbot over enterprise docsHybrid semantic + keyword product search
Snowflake Cortex preview image
Snowflake Cortex logo

Snowflake Cortex

RAG · Anthropic Claude, Meta Llama, Mistral Large 2, Snowflake Arctic
8.7

Generative AI and RAG built into the Snowflake data cloud

Enterprise· Standard: Contact sales · Enterprise: Contact sales · Business Critical: Contact sales · Virtual Private Snowflake: Contact salesEnterprise RAG chatbot over governed dataNatural-language SQL for business analysts
MongoDB Atlas Vector Search preview image
MongoDB Atlas Vector Search logo

MongoDB Atlas Vector Search

RAG · Bring-your-own embeddings (OpenAI, Cohere, open models); native Voyage AI embeddings and rerankers
8.6

Vector search built into the operational database you're already using.

Freemium· Free: $0 · Flex: Up to $30 · Dedicated: Starts at $56.94RAG over enterprise documentsProduct and content recommendation engines
Glean preview image
Glean logo

Glean

Agents · Model-agnostic: routes across 35+ LLMs including GPT-4o, Claude 3.5/4 Sonnet, Gemini 1.5/2, Llama 3, Mistral, plus Glean in-house models
8.5

Work AI platform that unifies enterprise knowledge, search, and agents

Enterprise· Enterprise pricing only; commonly reported in the $40-50/user/month range with a floor typically starting around 100 seats. No public self-serve tier. Contact sales for a quote.Enterprise search across Slack, Drive, Confluence and JiraCompany-wide AI assistant with citations
Replicate preview image
Replicate logo

Replicate

Fine-tuning · Thousands of community + first-party models
8.5

One-API platform for running and fine-tuning open-source models.

Paid· Pay-per-second of GPU timemodel hostingfine-tuning
ChatGLM (Zhipu Qingyan) preview image
ChatGLM (Zhipu Qingyan) logo

ChatGLM (Zhipu Qingyan)

Agents · GLM-4, GLM-4V, GLM-4-Air/Flash, CogView, CogVideoX (ChatGLM family, Zhipu AI / Tsinghua KEG)
8.4

Zhipu AI's bilingual ChatGLM assistant with agents, code, image and video generation

Freemium· Free consumer tier (chatglm.cn); paid API tiers via Zhipu Open Platform (bigmodel.cn) priced per million tokens by model (GLM-4, GLM-4-Air, GLM-4-Flash, GLM-4V, CogVideoX); enterprise/private deployment on requestChinese-language document drafting and rewritingChinese-English translation and localisation
Palantir AIP preview image
Palantir AIP logo

Palantir AIP

Agents · Multi-model (GPT, Claude, Llama, customer-hosted)
8.4

Enterprise AI platform that grounds LLMs in your operational data and runs agents against real business systems.

Enterprise· Contact sales; typically bundled with Foundryenterprise-agentsoperational-ai
PyCaret preview image
PyCaret logo

PyCaret

Coding · Multi-model (scikit-learn, XGBoost, LightGBM, CatBoost)
8.4

Low-code Python AutoML library that wraps scikit-learn, XGBoost, LightGBM and friends behind a few-line API.

Free· Free and open-source (MIT license)automlclassification
Quivr preview image
Quivr logo

Quivr

RAG · Multi-model (OpenAI, Anthropic, Mistral, Gemma)
8.4

Open-source RAG framework for building custom AI assistants over your own documents in a few lines of Python.

Free· Open source (pip install quivr-core); pay only for LLM/vector-store usagedocument-qacustom-knowledge-base
Semantic Kernel preview image
Semantic Kernel logo

Semantic Kernel

Agents · Multi-model
8.4

Microsoft's open-source SDK for wiring LLMs, plugins, and agents into enterprise .NET, Python, and Java apps.

Free· Free, MIT-licensed SDK; you pay for the underlying model APIsagent-orchestrationllm-plugins
Yi (01.AI) preview image
Yi (01.AI) logo

Yi (01.AI)

Agents · Yi-Lightning (MoE), Yi-Large, Yi-1.5 (6B/9B/34B), Yi-VL, Yi-Coder — in-house 01.AI foundation models
8.4

Foundation models from 01.AI — open-weight Yi family plus frontier Yi-Lightning and Yi-Large

Freemium· Open-source Yi models free under permissive license; hosted API via platform.lingyiwanwu.com with pay-per-token pricing (Yi-Lightning positioned as a low-cost frontier tier; Yi-Large priced higher; exact per-token rates on the platform dashboard). Enterprise custom-training and consulting on quote.Self-hosted coding assistantBilingual English-Chinese chatbot
ClearML preview image
ClearML logo

ClearML

Agents · Model-agnostic
8.3

End-to-end MLOps and GenAI platform with open-source experiment tracking and enterprise GPU orchestration.

Freemium· Community: $0 · Pro: $15 Per User/Month + Usage · Scale: Custom Quote · Enterprise: Request a Quoteexperiment-trackinggpu-orchestration
Dataiku preview image
Dataiku logo

Dataiku

Agents · Multi-model (LLM Mesh: OpenAI, Anthropic, Bedrock, Vertex, OSS)
8.3

Enterprise AI platform unifying data, ML, LLMs, and agents under one governed workflow.

Enterprise· Basic: $10 · Pro: $20 · Enterprise: Contact salesenterprise-aiagent-orchestration
H2O.ai preview image
H2O.ai logo

H2O.ai

Agents · Multi-model
8.3

Enterprise AI platform combining AutoML, generative AI, and vertical agents for regulated industries.

Enterprise· Contact sales; live demo on requestenterprise-agentsautoml
Llama preview image
Llama logo

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1
8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Freemium· Basic: $15 · Pro: $30 · Enterprise: $100self-hosted-llmfine-tuning
Llama 3 preview image
Llama 3 logo

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)
8.3

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Free· Weights free under Meta Llama Community License; inference cost via self-hosting or 3rd-party providerschatlong-context reasoning
LM Studio preview image
LM Studio logo

LM Studio

Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)
8.3

Desktop app for discovering, downloading, and running open-weight LLMs locally with an OpenAI-compatible server.

Freemium· Free: $0local-llm-inferenceprivate-chat
n8n preview image
n8n logo

n8n

Agents · Multi-model
8.3

Source-available workflow automation with first-class AI-agent and RAG building blocks.

Freemium· Starter: 20€ · Pro: 50€ · Business: 667€ · Enterprise: Contact Salesai-agentsworkflow-automation
Qwen preview image
Qwen logo

Qwen

Writing · Qwen3 / Qwen-Image / Qwen-MT / Qwen3Guard
8.3

Alibaba's open-weight foundation model family covering chat, vision, image generation, translation, and safety classification.

Freemium· Open weights free; hosted API priced per-token via Alibaba Cloud DashScopechatreasoning
RunPod preview image
RunPod logo

RunPod

Fine-tuning · Bring-your-own (any open-weight or custom model)
8.3

On-demand GPU cloud and serverless inference platform built specifically for AI workloads.

Paid· Pod: $7.39/hr · Pod: $4.39/hr · Pod: $5.89/hr · Pod: $1.99/hr · Pod: $3.19/hrllm-fine-tuninggpu-rental
Skyvern preview image
Skyvern logo

Skyvern

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)
8.3

AI browser agent that automates web workflows from natural-language instructions, with CAPTCHA and 2FA handling built in.

Freemium· Free: $0/month · Hobby: $29/month · Pro: $149/month · Enterprise: Custom/monthbrowser-automationdata-extraction
Vanna.ai preview image
Vanna.ai logo

Vanna.ai

RAG · Multi-model (Anthropic, OpenAI, Gemini, Ollama)
8.3

Open-source text-to-SQL agent that learns your schema and writes queries against your real warehouse.

Freemium· Explorer: $50 · Team: $500 · Enterprise: Contact salestext-to-sqlnatural-language-bi
vLLM preview image
vLLM logo

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)
8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

Free· Free and open-source (Apache 2.0); self-hosted infrastructure costs applyllm-servingself-hosted-inference
BentoML preview image
BentoML logo

BentoML

Agents · Multi-model
8.2

Open-source framework and managed platform for serving and scaling AI models in production.

Freemium· OSS free (Apache 2.0); managed Bento cloud has free tier + usage-based pricingmodel-servingllm-inference
Browser Use preview image
Browser Use logo

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)
8.2

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Freemium· PAYG: $0 · Dev: $29 · Business: $299 · Scaleup: $999web-automationscraping
Google AI Studio preview image
Google AI Studio logo

Google AI Studio

Coding · Gemini 2.5 Pro / Flash, Imagen, Veo
8.2

Browser-based playground and API console for prototyping with Google's Gemini models.

Freemium· Free tier with rate limits; paid via Gemini API usage-based pricingprompt-prototypinggemini-api-keys
Great Expectations preview image
Great Expectations logo

Great Expectations

Evaluation
8.2

Open-source data quality framework for validating the datasets that feed your ML and analytics pipelines.

Freemium· Developer: Free · Team: Custom · Enterprise: Contact Salesdata-validationpipeline-testing
HyperFrames preview image
HyperFrames logo

HyperFrames

Video · Multi-model (Claude Code skill; BYO agent)
8.2

Open-source video composition framework that lets AI agents build videos by writing HTML, CSS, and JS.

Free· Free, open-source (Apache 2.0)agent-driven videoprogrammatic video
Jan preview image
Jan logo

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)
8.2

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

Free· Free and open source; bring-your-own keys for cloud modelslocal-llm-chatprivate-ai-assistant
LibreChat preview image
LibreChat logo

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)
8.2

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Free· Free and open source; self-hosted (you pay model providers for API usage)multi-model chatself-hosted chatgpt
LiveBench preview image
LiveBench logo

LiveBench

Evaluation · Multi-model
8.2

Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.

Free· Free and open source; self-hosted evaluation runnerllm-benchmarkingmodel-selection
Ludwig preview image
Ludwig logo

Ludwig

Fine-tuning · Multi-model (PyTorch + HuggingFace Transformers)
8.2

Declarative, YAML-driven deep learning framework for fine-tuning LLMs and multi-modal models without writing training loops.

Free· Free, Apache 2.0 open sourcellm-fine-tuningmulti-modal-training
Msty preview image
Msty logo

Msty

Writing · Multi-model (Ollama, Claude, GPT, Gemini, others)
8.2

Privacy-first desktop AI workspace that runs local and cloud models side by side.

Freemium· Free: $0 · Aurum: ? · Aurum Lifetime: ? · Enterprise & Teams: Talk to uslocal-llm-chatmulti-model-comparison
SGLang preview image
SGLang logo

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)
8.2

Open-source high-throughput inference engine for LLMs and multimodal models with OpenAI-compatible serving.

Free· Free, open-source (Apache 2.0); self-hosted infra cost onlyllm-servingmultimodal-inference
Sim preview image
Sim logo

Sim

Agents · Multi-model (Claude, OpenAI, Google)
8.2

Open-source visual workspace for building, deploying, and monitoring AI agents.

Freemium· Free: $0 · Pro: $25 · Max: $100 · Enterprise: Customagent-workflowsinternal-automation
Unsloth preview image
Unsloth logo

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
Vellum preview image
Vellum logo

Vellum

Agents · Multi-model (Claude-class LLMs)
8.2

Personal AI assistant with persistent memory across email, calendar, and chat channels.

Freemium· Mighty: $30 · Super: $100 · Ultra: $200personal assistantemail triage
Writer preview image
Writer logo

Writer

Writing · Palmyra (in-house)
8.2

Enterprise generative AI platform built around in-house Palmyra LLMs for regulated, brand-consistent content.

Enterprise· Starter: Free · ENTERPRISE: Contact salesenterprise-writingbrand-voice
Athina AI preview image
Athina AI logo

Athina AI

Evaluation · Multi-model
8.1

Collaborative LLM evaluation and observability platform for teams shipping AI features to production.

Freemium· Starter free (10k logs/mo); Pro & Enterprise customllm-evaluationprompt-management
Berkeley Function-Calling Leaderboard preview image
Berkeley Function-Calling Leaderboard logo

Berkeley Function-Calling Leaderboard

Evaluation · Multi-model
8.1

Open benchmark from UC Berkeley that ranks LLMs on real-world tool-use and function-calling accuracy.

Free· Free and open source; you pay only for inference when reproducing runs.function-calling evaltool-use benchmarking
Cube preview image
Cube logo

Cube

RAG · Multi-model
8.1

Semantic layer that grounds LLM agents in your real business metrics instead of letting them hallucinate SQL.

Freemium· Cube Core open source; Cube Cloud paid, contact salessemantic-layerembedded-analytics
ElevenLabs Conversational AI preview image
ElevenLabs Conversational AI logo

ElevenLabs Conversational AI

Audio · ElevenLabs Scribe (ASR) + pluggable LLM + ElevenLabs TTS
8.1

Production-grade voice agent platform layering ElevenLabs TTS, ASR, and LLM orchestration into a single deployable stack.

Paid· Free: $0 · Starter: $6 · Creator: $11 · Pro: $99 · Scale: $299voice-agentsivr-replacement