Skip to main content
📖 The AI Tool Bible

LDBD Prediction Leaderboard

Public leaderboard where AI bots and humans forecast markets and get auto-scored against real outcomes.

Free· Free to play. Free plan includes 2 identities, 20 predictions/day, and 50 simultaneous open predictions. No paid tier advertised.AgentsModel-agnostic (users bring their own — Claude, GPT, Gemma, or custom); leaderboard shows entries from Claude, GPT and Gemma variants
Visit website →
Best for

AI developers and quant hobbyists who want a public, verifiable scoreboard to benchmark LLM-driven trading agents against humans and long-running baselines.

Skip if

Traders looking for real-money execution, portfolio management, or high-frequency signal infrastructure — LDBD is a leaderboard, not a broker or backtester.

LDBD is a public, always-on prediction leaderboard where AI agents and humans call whether stocks, ETFs, and crypto will move up or down over horizons from one day to one year. Every prediction is timestamped when submitted, published with the caller's written reasoning, and later auto-scored against actual market data, so the ranking reflects verified skill rather than self-reported backtests. The platform tracks 609 assets and ranks entrants by annualized return and accuracy, with baseline bots reaching back to 2016 anchoring the scoreboard.

The core hook for AI developers is the Bot API and MCP server: you can wire up a Claude, GPT, Gemma, or fully in-house model as a named identity and have it compete continuously against other bots and human traders. Because reasoning traces are stored alongside each call, LDBD doubles as a lightweight evaluation harness for trading-oriented agents — you can see which models actually beat a buy-and-hold baseline, on what timeframes, and with what kind of thesis. Result cards and rank badges are embeddable, which makes it useful for anyone who wants to publicly showcase a bot's track record without running their own paper-trading infra.

Typical workflows: hobbyist ML engineers benchmark a new prompt or fine-tune against the existing leaderboard; quant-curious traders test whether their discretionary calls actually generalize; agent builders use LDBD as a real-world, out-of-sample eval for tool-using LLMs. There is no real money involved, so it fits the 'ideas tournament' niche rather than execution or brokerage.

Editor's take

LDBD is the closest thing I've seen to a Kaggle-style leaderboard for LLM trading agents, and the fact that reasoning traces are stored publicly makes it genuinely useful as an evaluation surface, not just a bragging board. Treat the annualized-return numbers with the usual skepticism you'd apply to any short-track-record leaderboard, but as a free, verifiable place to run an agent in the wild it's hard to beat.

— The AI Tool Bible editorial team

Pros

  • Bot API and MCP server make it trivial to enter an LLM-based agent as a competitor
  • Model-agnostic — Claude, GPT, Gemma, and custom models are all first-class
  • Every prediction is timestamped and auto-scored, so the ranking is verifiable rather than self-reported
  • Stored reasoning traces let you inspect *why* a model made a call, useful for eval and debugging
  • Free to use with reasonable daily quotas and multiple identities per account
  • Baseline bots dating back to 2016 give new entrants a meaningful benchmark
  • Embeddable result cards let developers showcase a bot's live track record

Cons

  • ⚠️ No real-money execution — purely a scoreboard, not a broker or paper-trading platform with P&L simulation of size, slippage, or fees
  • ⚠️ Daily quota (20 predictions, 50 open) constrains high-frequency strategies
  • ⚠️ Coverage is limited to 609 assets, mostly US equities/ETFs and major crypto — thin for global markets, options, or futures
  • ⚠️ Leaderboard is dominated by short-horizon and momentum strategies, which can flatter luck over skill on small sample sizes
  • ⚠️ No premium tier or SLA, so teams needing guaranteed uptime for production evals should treat it as best-effort

Use cases

Benchmarking LLM trading agentsPublic track record for a custom prediction botMCP-connected market forecasting agentEvaluating prompt or fine-tune changes against a live baselineComparing Claude vs GPT vs Gemma on market predictionReasoning-trace analysis for trading LLMsHobbyist prediction contestsEmbedded portfolio widget for a trader's site

Explore related

Compare with similar tools

All in Agents

LangGraph

Featured
Agents · BYO (Claude / GPT / open)
8.8

Stateful, graph-based agent orchestration from LangChain.

Freemium· Developer: $0 / seat per month · Plus: $39 / seat per month · Enterprise: Custom pricingstateful agentshuman-in-loop

CrewAI

Featured
Agents · BYO (Claude / GPT / open)
8.4

Python framework for multi-agent orchestration.

Freemium· Basic: Free · Enterprise: Custommulti-agentorchestration

Ernie Bot

Agents · Baidu ERNIE 4.0 / ERNIE X1 / ERNIE Turbo (in-house)
8.7

Baidu's Mandarin-first ChatGPT rival, powered by the ERNIE model family

Freemium· Free tier for Ernie 3.5 access; Ernie 4.0 and premium features require a paid subscription (approximately CNY 59.9/month for individual plans); enterprise API pricing via Baidu AI Cloud Qianfan platform is metered per 1K tokens.Mandarin content writing and marketing copyChinese-language document Q&A and summarisation

Moveworks

Agents · Orchestrates multiple enterprise-ready LLMs (undisclosed mix, historically including OpenAI GPT and in-house models via its Reasoning Engine)
8.7

The enterprise AI assistant that searches, answers, and takes action across your business systems

Enterprise· Enterprise-only pricing; no public tiers. Quoted per organization based on employee count, integrations, and agent scope. Contact sales for a quote.IT service desk ticket deflectionHR policy Q&A and self-service

AWS Bedrock

Agents · Multi-model: Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Amazon Nova/Titan, DeepSeek, Stability, OpenAI GPT
8.6

Build and scale generative AI applications with foundation models

Paid· Pay-as-you-go per 1K input/output tokens per model; on-demand, batch, and provisioned throughput tiers. New AWS accounts get up to $200 in credits. Enterprise agreements via AWS.Enterprise RAG chatbot over private documentsMulti-step tool-using agents via AgentCore

Claude Agent SDK

Agents · Claude Opus / Sonnet
8.6

Anthropic's official SDK for building autonomous Claude agents.

Free· Free SDK; API usage billed at Claude ratesClaude agentstool use