
Weco AI
Autoresearch engine that iteratively rewrites code to optimize against a numeric evaluation metric.
In short
Weco AI is an autoresearch engine that pairs LLM-driven code proposals with tree search to optimize code against a user-supplied numeric evaluation metric. It is best suited for ML and systems engineers needing autonomous iteration on measurable objectives like GPU kernel tuning or model accuracy.
Pick Weco AI if you have a measurable objective (kernel speed, model accuracy, prompt score) and want an agent to iterate against it autonomously.
Skip it if your problem has no single numeric metric, or if you just need a one-time refactor a normal coding copilot can do in one pass.
Weco AI is a code-optimization platform built around the AIDE algorithm, which pairs LLM-driven code proposals with tree search to iteratively improve a codebase against a user-supplied evaluation script. You hand it source code plus an eval that emits a number (latency, accuracy, memory, cost, throughput, quality score), and it loops: propose change, run eval, read metric, branch on what improved. The team describes the product as 'recursively self-improving AI' and ships a CLI (weco-cli) backed by docs at docs.weco.ai.
It's aimed at ML and systems engineers who have problems where the optimum isn't obvious and brute-force experimentation pays off: GPU kernel tuning (CUDA, Triton), model architecture tweaks, prompt engineering with measurable scoring, and general perf work. The same group is behind AIDE (the agent that posted human-level results on Kaggle-style data science competitions) and the Aiden agent that placed top in OpenAI's hiring challenge, so the research pedigree is real. Pricing isn't published on the marketing site; the CLI is open and the hosted autoresearch service appears to be the commercial layer.
It's language-agnostic and hardware-agnostic because the only contract is 'your eval prints a number.' That makes it powerful for the niche it serves and useless for tasks where success can't be expressed numerically or where a one-shot edit would do.
Weco is one of the more intellectually honest 'agent' products out there - it refuses to pretend it can optimize what you can't measure. For ML and systems engineers with a real eval harness, the AIDE-driven loop is a credible alternative to hand-tuning. Outside that niche it's not the tool you want.
— The AI Tool Bible editorial team
Pros
- ✅ Metric-driven optimization loop is principled, not vibes-based
- ✅ Language and hardware agnostic - only needs a numeric eval
- ✅ Strong research pedigree (AIDE, Aiden, SpecBench)
- ✅ Open CLI (weco-cli) lowers integration friction
- ✅ Genuinely useful for GPU kernel and ML perf work
Cons
- ⚠️ Only works when success can be expressed as a single number
- ⚠️ Pricing for hosted product not publicly disclosed
- ⚠️ Overkill for one-shot code edits or qualitative tasks
- ⚠️ Smaller community than mainstream AI eval tools
Use cases
Frequently asked
- How does Weco AI optimize code?
- It uses the AIDE algorithm to pair LLM-driven code proposals with tree search. The system iteratively proposes changes, runs a user-supplied evaluation script, and branches based on which changes improve the numeric metric.
- What types of tasks is Weco AI designed for?
- It is aimed at ML and systems engineers working on problems where the optimum is not obvious, such as GPU kernel tuning, model architecture tweaks, and prompt engineering with measurable scoring.
- Is Weco AI available as open source?
- The CLI (weco-cli) is open source, while the hosted autoresearch service appears to be the commercial layer. The overall product is categorized as freemium, though specific hosted pricing is not published.
- What are the limitations of using Weco AI?
- The tool only works when success can be expressed as a single numeric metric. It is considered overkill for one-shot code edits or qualitative tasks where a standard coding copilot would suffice.
- Does Weco AI support different programming languages and hardware?
- Yes, it is language-agnostic and hardware-agnostic because the only requirement is that the user's evaluation script prints a number.
Explore related
Compare with similar tools
All in Evaluation →
Braintrust
FeaturedEval, monitor, and improve AI products end-to-end.

LangSmith
LangChain's eval + observability platform.

Weights & Biases
The ML experiment tracker, now with LLM eval features.
Helicone
Open-source LLM observability — one-line proxy install.

Arize AI
Enterprise observability and evaluation platform for LLM agents and generative AI applications.

Giskard
Continuous AI red teaming platform that stress-tests LLM agents for vulnerabilities before they hit production.