AI tools tagged Powered By Llama

LlamaIndex

Featured

RAG · BYO (Claude / GPT / open)

8.7

Data framework for connecting LLMs to your data.

Together AI

Featured

Fine-tuning · Llama / Mistral / Qwen / DeepSeek and others

8.6

Fine-tune & serve open-weight models (Llama, Mistral, DeepSeek).

Replicate

Fine-tuning · Thousands of community + first-party models

8.5

One-API platform for running and fine-tuning open-source models.

LangChain

RAG · BYO (any major LLM)

8.3

The broad LLM application framework — chains, agents, retrievers.

Continue

Coding · BYO (any OpenAI-compatible API + Ollama for local)

7.9

Open-source, self-hostable VS Code/JetBrains AI assistant.

AI Dungeon

Writing · Multi-model (rotating open-weights: Mixtral, Llama, Hermes variants)

AI-powered text adventure platform where the story is generated turn-by-turn by an LLM.

Agenta

Evaluation · Multi-model

Open-source LLMOps platform for prompt engineering, evaluation, and observability in one workspace.

AgenticSeek

Agents · Bring-your-own local LLM (Ollama / llama.cpp compatible)

Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.

AnythingLLM

RAG · Multi-model

Open-source desktop and self-hosted app that turns your documents into a private chat-and-agent workspace.

Arthur

Evaluation · Multi-model

Open-source toolkit for testing, tracing, and monitoring production AI agents.

AstrBot

Agents · Multi-model (OpenAI, Anthropic, Gemini, DeepSeek, Ollama, Dify, Coze)

Open-source agentic AI assistant that bridges chat platforms like Telegram, Discord, and QQ with any LLM and a 1000+ plugin ecosystem.

BGE (BAAI General Embedding)

RAG · BGE / bge-m3 / bge-reranker

Open-source embedding and reranker models from BAAI that anchor a huge share of production RAG stacks.

BentoML

Agents · Multi-model

Open-source framework and managed platform for serving and scaling AI models in production.

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Browser Use Web UI

Agents · Multi-model

Gradio web UI for running browser-use AI agents in a real or persistent Chrome session.

Chainlit

Agents · Multi-model

Open-source Python framework for building production-grade conversational AI interfaces in minutes.

Cherry Studio

Agents · Multi-model

Open-source desktop AI client that wires 300+ LLMs into one chat, knowledge-base, and agent workspace.

CompassRank

Evaluation · Multi-model

Public leaderboard from the OpenCompass project ranking open and closed LLMs across 100+ benchmarks.

Databricks Vector Search

RAG · Multi-model (BYO embeddings or Databricks-hosted)

Managed hybrid vector search that lives inside the Databricks lakehouse and auto-syncs with your source tables.

DeepSearcher

RAG · Multi-model (DeepSeek, OpenAI o1/o3-mini, Claude, Llama, others)

Open-source agentic RAG framework for private enterprise data, built by the Zilliz/Milvus team.

ElizaOS

Agents · Multi-model (BYO via plugins)

Open-source agentic OS for building and orchestrating multi-agent swarms across Discord, Telegram, X, and onchain.

Epsilla

RAG · Multi-model

Agent-as-a-Service platform with managed RAG and a no-code builder for vertical enterprise AI.

GPTLocalhost

Writing · Bring-your-own (Ollama, LM Studio, llama.cpp, Foundry Local, etc.)

Run local LLMs directly inside Microsoft Word without sending text to the cloud.

Groq

Coding · Multi-model (Llama, Mixtral, Gemma, Qwen, Whisper)

Custom-silicon LPU inference platform serving open models at GPU-trouncing latency via an OpenAI-compatible API.

Haystack

RAG · Multi-model

Open-source Python framework from deepset for building production RAG pipelines and LLM agents.

Hermes One

Agents · Multi-model (BYO via OpenRouter/OpenAI/Anthropic/Gemini/xAI/Ollama)

Open-source desktop AI agent with a self-improving learning loop and multi-platform messaging connectors.

IntelliBar

Writing · Multi-model (GPT-4o, Claude 3.5, Gemini, o1, Llama, DeepSeek, Ollama)

Native macOS menu-bar client that talks to every major LLM with your own API keys.

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

KNIME

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)

Visual node-based data science platform with built-in connectors for OpenAI, Anthropic, Gemini, and local LLMs.

Katonic AI

Agents · Multi-model (2,600+ via AI Gateway)

Sovereign enterprise platform for building, deploying, and governing AI agents on your own infrastructure.

Kiln AI

Evaluation · Multi-model

Open-source workbench for building, evaluating, and fine-tuning AI agents across 190+ models.

Kilo Code

Coding · Multi-model (500+ via BYO keys or routing)

Open-source agentic coding assistant for VS Code, JetBrains, and the terminal with bring-your-own-key routing across 500+ models.

Kotaemon

RAG · Multi-model (OpenAI, LlamaCPP, any OpenAI-compatible endpoint)

Open-source RAG UI for chatting with your own documents, locally or self-hosted.

LLM by Datasette

Coding · Multi-model

A CLI and Python library for running prompts against any LLM provider and logging everything to SQLite.

LLaMA Factory

Fine-tuning · Multi-model (LLaMA, Mistral, Qwen, Gemma, Phi, LLaVA, ChatGLM, Yi)

Open-source, no-code WebUI for fine-tuning 100+ open LLMs with LoRA, QLoRA, DPO, and PPO.

LM Studio

Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)

Desktop app for discovering, downloading, and running open-weight LLMs locally with an OpenAI-compatible server.

LMQL

Coding · Multi-model (OpenAI, Hugging Face Transformers, llama.cpp)

A query language for LLMs that bolts types, templates, and constraints onto prompting.

LangExtract

RAG · Multi-model (Gemini, GPT-4/4o, Ollama-hosted local models)

Google's open-source Python library for LLM-driven structured extraction from unstructured text, with source-grounded outputs.

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

Langflow

Agents · Multi-model

Open-source visual builder for LangChain-style AI agents and RAG pipelines.

Langfuse

Evaluation · Model-agnostic

Open-source LLM observability, prompt management, and evaluation in one platform.

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

LiveBench

Evaluation · Multi-model

Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)

Self-hosted OpenAI-compatible API for running LLMs, image, and audio models on your own hardware.

MCP Toolbox for Databases

Agents · Multi-model

Open-source MCP server that wires AI agents and IDEs straight into 50+ production databases with auth, pooling, and observability baked in.

Manifest

Agents · Multi-model

Open-source LLM router that fans your agent traffic across providers and your existing AI subscriptions.