Skip to main content
📖 The AI Tool Bible

Search 919 AI tools

Search across names, taglines, descriptions, use cases, and underlying models. Quoted phrases and -word negation are supported.

30 results for "open source llm"

Helicone preview image
Helicone logo

Helicone

Evaluation · Platform (any LLM)
8.3

Open-source LLM observability — one-line proxy install.

Freemium· Free 100k req/mo; Pro from $25/moobservabilitycost tracking
Opik preview image
Opik logo

Opik

Evaluation · Multi-model
7.3

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Freemium· Free open-source self-host; free Cloud tier (no card); Enterprise contact salesllm-tracingagent-evaluation
Langfuse preview image
Langfuse logo

Langfuse

Evaluation · Model-agnostic
7.3

Open-source LLM observability, prompt management, and evaluation in one platform.

Freemium· Free self-host & Hobby tier; Core $29/mo, Pro $199/mo, Enterprise $2,499/mollm-observabilityprompt-management
Rivet preview image
Rivet logo

Rivet

Agents · Multi-model
8.0

Open-source visual IDE for building and debugging LLM agent graphs.

Free· Free and open source (MIT)agent-orchestrationprompt-chaining
Gorilla preview image
Gorilla logo

Gorilla

Agents · gorilla-openfunctions-v2 (6.91B)
7.3

Open-source LLM purpose-built for function calling and API invocation across thousands of tools.

Free· Free and Apache 2.0; self-hostedfunction-callingtool-use
MemPalace preview image
MemPalace logo

MemPalace

Agents · Embedding backends: embedding-gemma-300m (multilingual) or all-MiniLM-L6-v2 (English). No LLM required for retrieval.

Open-source, local-first AI memory system for LLM agents

Free· Free and open-source under the MIT license. No paid tiers; self-hosted with zero API costs once installed.Persistent memory for Claude Code and Cursor sessionsPer-agent memory isolation in multi-agent systems
Phoenix preview image
Phoenix logo

Phoenix

Evaluation · Multi-model
7.0

Open-source LLM and agent observability platform with tracing, evals, and experimentation built on OpenTelemetry.

Freemium· AX Free: Free · AX Pro: $50 · AX Enterprise: Customllm-tracingagent-debugging
Langchain-Chatchat preview image
Langchain-Chatchat logo

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)
7.4

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Free· Apache-2.0 open source; self-hosted, infra costs onlyprivate-knowledge-baseoffline-rag
Unsloth preview image
Unsloth logo

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)
8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora
Browser Use preview image
Browser Use logo

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)
8.2

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Freemium· PAYG: $0 · Dev: $29 · Business: $299 · Scaleup: $999web-automationscraping
Haystack preview image
Haystack logo

Haystack

RAG · Multi-model
6.9

Open-source Python framework from deepset for building production RAG pipelines and LLM agents.

Freemium· Open-source free; deepset Enterprise Support and AI Platform via salesragagents
MLflow preview image
MLflow logo

MLflow

Evaluation · Multi-model
8.1

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Free· Free and open source (Apache 2.0); managed offering via Databricksllm-evaluationexperiment-tracking
Inspect AI preview image
Inspect AI logo

Inspect AI

Evaluation · Multi-model
7.2

Open-source LLM evaluation framework from the UK AI Security Institute with 200+ built-in benchmarks.

Free· Free and open source (MIT-style license); you pay only for underlying model API usage.llm-benchmarkingagent-evaluation
Manifest logo

Manifest

Agents · Multi-model
7.1

Open-source LLM router that fans your agent traffic across providers and your existing AI subscriptions.

Freemium· Free: $0 /month · Pro: $19 /month · Enterprise: Let's Talkllm-routingcost-control
Promptfoo preview image
Promptfoo logo

Promptfoo

Evaluation · Multi-model
7.2

Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.

Freemium· Community: Free · Enterprise: Custom · On-Premise: Customllm-evalsred-teaming
Linear MCP Server logo

Linear MCP Server

MCP Servers

Open-source MCP server bridging LLM agents to Linear's issue tracker (now deprecated in favour of Linear's official remote MCP)

Free· Free and open source (MIT). Requires a Linear account and personal API key; Linear itself is free for small teams, $8/user/mo Standard, $14/user/mo Plus.Filing bugs from Claude Desktop or Cursor without leaving the editorAgent-driven triage of the inbox project
LangExtract preview image
LangExtract logo

LangExtract

RAG · Multi-model (Gemini, GPT-4/4o, Ollama-hosted local models)
7.1

Google's open-source Python library for LLM-driven structured extraction from unstructured text, with source-grounded outputs.

Free· Library is free (Apache-2.0); LLM API costs depend on chosen backendstructured-extractiondocument-parsing
Home Assistant MCP logo

Home Assistant MCP

MCP Servers

Open-source MCP server that lets any LLM control and observe a Home Assistant smart home in real time.

Free· Free and open source (Apache 2.0). Self-hosted; only cost is your own Home Assistant instance and the LLM client you connect to it.Conversational smart-home control from Claude Desktop or CursorLLM-driven Home Assistant automations
TruLens preview image
TruLens logo

TruLens

Evaluation · Multi-model (LLM-as-judge)
8.1

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Free· Free, open source (Apache-licensed Python package)llm-evaluationrag-evaluation
OpenCode preview image
OpenCode logo

OpenCode

Coding · Multi-model (Claude, GPT, Gemini, local models, 75+ providers)
7.0

Open-source AI coding agent that runs in your terminal, IDE, or desktop and talks to 75+ LLM providers.

Freemium· Free and open source; optional paid Zen service for curated coding modelsai-pair-programmingterminal-coding-agent
Sematic preview image
Sematic logo

Sematic

Agents
7.3

Open-source Python-first orchestrator for ML training pipelines from laptop to cloud.

Freemium· Open-source free; managed/enterprise tier on requestml-pipelinestraining-orchestration
ClearML preview image
ClearML logo

ClearML

Agents · Model-agnostic
8.3

End-to-end MLOps and GenAI platform with open-source experiment tracking and enterprise GPU orchestration.

Freemium· Community: $0 · Pro: $15 Per User/Month + Usage · Scale: Custom Quote · Enterprise: Request a Quoteexperiment-trackinggpu-orchestration
Open Deep Research preview image
Open Deep Research logo

Open Deep Research

Agents · o3-mini (default), DeepSeek R1, or any OpenAI-compatible model
7.2

Minimal open-source deep-research agent that iteratively searches, scrapes, and reasons to produce cited markdown reports.

Free· Free (MIT); bring your own Firecrawl + LLM API keysdeep-researchagent-scaffolding
MCP Toolbox for Databases preview image
MCP Toolbox for Databases logo

MCP Toolbox for Databases

Agents · Multi-model
7.2

Open-source MCP server that wires AI agents and IDEs straight into 50+ production databases with auth, pooling, and observability baked in.

Free· Free and open source (Apache 2.0); self-hostedagent-database-accessmcp-server
OpenBB preview image
OpenBB logo

OpenBB

Agents · Multi-model (Agent Rita is model-agnostic)
7.3

Open-source financial workspace where analysts and AI agents share the same governed data.

Freemium· Community: Free · Lite: $100 · Pro: Custom pricing · Snowflake: $41.67financial-researchinvestment-workflows
Nyamuru Manga Name Studio preview image
Nyamuru Manga Name Studio logo

Nyamuru Manga Name Studio

Writing · Model-agnostic (BYO LLM — prompts designed for ChatGPT, Claude, Gemini, or local models)

Open-source PWA for drafting manga storyboards (ネーム) with LLM-ready prompts and a structured OMNY data format.

Free· Free and open source (MIT License). No paid tiers; users bring their own LLM if they want to use the included AI prompts.Drafting manga storyboards (ネーム) from a prose scriptConverting light-novel scenes into structured panel layouts via an LLM
WeKnora preview image
WeKnora logo

WeKnora

RAG · Multi-model
7.2

Tencent's open-source RAG framework that turns raw documents into a queryable knowledge base, ReAct agent, and self-maintaining wiki.

Free· Free, open-source (self-hosted)document-qaenterprise-knowledge-base
Llama 3 preview image
Llama 3 logo

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)
8.3

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Free· Weights free under Meta Llama Community License; inference cost via self-hosting or 3rd-party providerschatlong-context reasoning
LibreChat preview image
LibreChat logo

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)
8.2

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Free· Free and open source; self-hosted (you pay model providers for API usage)multi-model chatself-hosted chatgpt
Together AI Fine-tuning preview image
Together AI Fine-tuning logo

Together AI Fine-tuning

Fine-tuning · Multi-model (any Hugging Face open-source model)
8.1

Managed fine-tuning platform for open-source LLMs and vision models with LoRA, full fine-tuning, and RL support.

Paid· Usage-based; cost estimator in-product, no public price listllm-fine-tuningvision-fine-tuning