📖 The AI Tool Bible

Search 676 AI tools

Search across names, taglines, descriptions, use cases, and underlying models. Quoted phrases and -word negation are supported.

30 results for "open source llm"

Helicone

Evaluation · Platform (any LLM)
8.3

Open-source LLM observability — one-line proxy install.

Freemium· Free 100k req/mo; Pro from $25/moobservabilitycost tracking

Opik

Evaluation · Multi-model

Open-source LLM observability and evaluation platform for debugging and monitoring AI agents in production.

Freemium· Free open-source self-host; free Cloud tier (no card); Enterprise contact salesllm-tracingagent-evaluation

Langfuse

Evaluation · Model-agnostic

Open-source LLM observability, prompt management, and evaluation in one platform.

Freemium· Free self-host & Hobby tier; Core $29/mo, Pro $199/mo, Enterprise $2,499/mollm-observabilityprompt-management

Rivet

Agents · Multi-model

Open-source visual IDE for building and debugging LLM agent graphs.

Free· Free and open source (MIT)agent-orchestrationprompt-chaining

Gorilla

Agents · gorilla-openfunctions-v2 (6.91B)

Open-source LLM purpose-built for function calling and API invocation across thousands of tools.

Free· Free and Apache 2.0; self-hostedfunction-callingtool-use

Phoenix

Evaluation · Multi-model

Open-source LLM and agent observability platform with tracing, evals, and experimentation built on OpenTelemetry.

Freemium· Open source (ELv2) + free Phoenix Cloud; paid Arize AX for enterprisellm-tracingagent-debugging

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Free· Apache-2.0 open source; self-hosted, infra costs onlyprivate-knowledge-baseoffline-rag

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Freemium· Free open-source; Pro and Enterprise contact saleslora-finetuningqlora

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Freemium· Free open-source library; cloud usage-based with free tier and enterprise plansweb-automationscraping

Haystack

RAG · Multi-model

Open-source Python framework from deepset for building production RAG pipelines and LLM agents.

Freemium· Open-source free; deepset Enterprise Support and AI Platform via salesragagents

MLflow

Evaluation · Multi-model

Open-source platform for tracking, evaluating, and deploying ML models and LLM applications.

Free· Free and open source (Apache 2.0); managed offering via Databricksllm-evaluationexperiment-tracking

Inspect AI

Evaluation · Multi-model

Open-source LLM evaluation framework from the UK AI Security Institute with 200+ built-in benchmarks.

Free· Free and open source (MIT-style license); you pay only for underlying model API usage.llm-benchmarkingagent-evaluation

Manifest

Agents · Multi-model

Open-source LLM router that fans your agent traffic across providers and your existing AI subscriptions.

Freemium· Open-source self-host is free; managed cloud in early accessllm-routingcost-control

Promptfoo

Evaluation · Multi-model

Open-source eval and red-teaming framework for LLM apps, prompts, and RAG pipelines.

Freemium· Open-source free; Enterprise SaaS contact salesllm-evalsred-teaming

LangExtract

RAG · Multi-model (Gemini, GPT-4/4o, Ollama-hosted local models)

Google's open-source Python library for LLM-driven structured extraction from unstructured text, with source-grounded outputs.

Free· Library is free (Apache-2.0); LLM API costs depend on chosen backendstructured-extractiondocument-parsing

TruLens

Evaluation · Multi-model (LLM-as-judge)

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

Free· Free, open source (Apache-licensed Python package)llm-evaluationrag-evaluation

OpenCode

Coding · Multi-model (Claude, GPT, Gemini, local models, 75+ providers)

Open-source AI coding agent that runs in your terminal, IDE, or desktop and talks to 75+ LLM providers.

Freemium· Free and open source; optional paid Zen service for curated coding modelsai-pair-programmingterminal-coding-agent

Sematic

Agents

Open-source Python-first orchestrator for ML training pipelines from laptop to cloud.

Freemium· Open-source free; managed/enterprise tier on requestml-pipelinestraining-orchestration

ClearML

Agents · Model-agnostic

End-to-end MLOps and GenAI platform with open-source experiment tracking and enterprise GPU orchestration.

Freemium· Free open-source + hosted tier; enterprise pricing on requestexperiment-trackinggpu-orchestration

Open Deep Research

Agents · o3-mini (default), DeepSeek R1, or any OpenAI-compatible model

Minimal open-source deep-research agent that iteratively searches, scrapes, and reasons to produce cited markdown reports.

Free· Free (MIT); bring your own Firecrawl + LLM API keysdeep-researchagent-scaffolding

MCP Toolbox for Databases

Agents · Multi-model

Open-source MCP server that wires AI agents and IDEs straight into 50+ production databases with auth, pooling, and observability baked in.

Free· Free and open source (Apache 2.0); self-hostedagent-database-accessmcp-server

OpenBB

Agents · Multi-model (Agent Rita is model-agnostic)

Open-source financial workspace where analysts and AI agents share the same governed data.

Freemium· Free Community Edition; paid Pro tiers via pro.openbb.cofinancial-researchinvestment-workflows

WeKnora

RAG · Multi-model

Tencent's open-source RAG framework that turns raw documents into a queryable knowledge base, ReAct agent, and self-maintaining wiki.

Free· Free, open-source (self-hosted)document-qaenterprise-knowledge-base

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Free· Weights free under Meta Llama Community License; inference cost via self-hosting or 3rd-party providerschatlong-context reasoning

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

Free· Free and open source; self-hosted (you pay model providers for API usage)multi-model chatself-hosted chatgpt

Together AI Fine-tuning

Fine-tuning · Multi-model (any Hugging Face open-source model)

Managed fine-tuning platform for open-source LLMs and vision models with LoRA, full fine-tuning, and RL support.

Paid· Usage-based; cost estimator in-product, no public price listllm-fine-tuningvision-fine-tuning

PPT Master

Writing · Bring your own LLM

Open-source AI that turns documents into natively editable PowerPoint decks with real shapes, not flattened images.

Free· Free, MIT-licensed; bring your own LLM API keydocument-to-pptxslide-generation

Bisheng

Agents · Multi-model

Open-source enterprise AgentOps platform for building, orchestrating, and governing LLM agents at scale.

Freemium· Open-source community edition free; commercial enterprise edition via DataElement salesagent-orchestrationrag

Arthur

Evaluation · Multi-model

Open-source toolkit for testing, tracing, and monitoring production AI agents.

Freemium· Open-source (MIT) + free SaaS tier; paid/enterprise plans on requestagent-evaluationprompt-management

DeerFlow

Agents · Multi-model (Doubao, DeepSeek, OpenAI, Gemini)

Open-source multi-agent framework from ByteDance for long-running research, coding, and content tasks.

Free· Free, MIT-licensed (self-hosted; you pay only for LLM tokens)deep-researchautonomous-coding