AI tools that integrate with Github

AI-Flow

Agents · Multi-model (OpenAI, Anthropic, Google, Replicate, xAI)

Visual node-based builder for chaining OpenAI, Anthropic, Replicate and other model APIs into content pipelines.

AgenticSeek

Agents · Bring-your-own local LLM (Ollama / llama.cpp compatible)

Open-source local-first AI agent that browses the web, writes code, and runs tasks without sending anything to the cloud.

InfiBench

Evaluation

Stack Overflow-derived benchmark for evaluating code LLMs on real-world programming questions.

LLMEval

Evaluation · Multi-model

Open academic benchmark suite for stress-testing LLMs on contamination-resistant, domain-specific tasks.

SWE-agent

Agents · Multi-model (GPT-4o, Claude Sonnet, DeepSeek, local via LiteLLM)

Open-source autonomous agent framework that lets LLMs fix GitHub issues and find security vulnerabilities by using a custom agent-computer interface.

Superset

Agents · Multi-model

Desktop code editor that orchestrates many AI coding agents in parallel using isolated Git worktrees.