Skip to content

Alpha

Models
Rankings
Ori

Footer

© 2026 OpenRouter, Inc

Product

Chat
Rankings
Benchmarks
Apps
Discover
Models
Ori
Collections
Providers
Tools
Pricing
Business
EU routing
Enterprise
Labs

Company

About
Blog
Careers
Hiring
Privacy
Terms of Service
Trust Center
Support
Works With OR
Data
Brand

Developer

Documentation
API Reference
Developer Platform
Status
AI Site Map

Connect

Discord
GitHub
LinkedIn
X
YouTube

Benchmarks

Independent, reproducible measurements of the knobs you can actually set on an OpenRouter request: models, providers, search engines, and tool budgets. Every score links to the configuration, costs, and telemetry behind it.

13 benchmarks2,309,227 task evaluationslast run Oct 26, 2026

Fetch benchmark results and metadata via the API

Agents & tools

BenchmarkQualityValueSpeed

τ²-Bench Airline
Multi-turn service agents making tool calls under strict policy constraints.
150 modelslast run Oct 26, 2026
79.9%
Claude Fable 5
$0.009
GLM 5.3 Flash
42s
GLM 5.3
Quality79.9%
Claude Fable 5
Value$0.009
GLM 5.3 Flash
Speed42s
GLM 5.3

Media

Generated images, clips and speech, graded against the request and priced per output.

BenchmarkSamplesValueSpeed

Image
Image prompts built to fail: depth, direction, counting, and text in the frame.
--
--
Value--
Speed--
Video
Six seconds of video, held to one duration and resolution across every model.
--
--
Value--
Speed--
Speech
One sentence, every voice: did the words come back, and was direction performed?
--
--
Value--
Speed--
Memes
Edit a meme as an image or animate it as a clip, graded on whether the brief landed.
--
--
Value--
Speed--

Artifact generation

Text models take on unconventional tasks like creating drawings and playable games.

BenchmarkSamplesValueSpeed

Sketch
Text models create drawings from prompts. The results are graded as images.
--
--
Value--
Speed--
Games
Text models create playable games from a single brief in one attempt.
--
--
Value--
Speed--

Reasoning

BenchmarkQualityValueSpeed

GPQA Diamond
Graduate-level science questions that resist retrieval and reward careful reasoning.
169 modelslast run Oct 26, 2026
96.5%
Gemini 4 Argon
$0.003
Pareto 26.10 Preview
20s
Claude Sonnet 5.5
Quality96.5%
Gemini 4 Argon
Value$0.003
Pareto 26.10 Preview
Speed20s
Claude Sonnet 5.5
VGI-Bench
Multiple-choice questions about long videos: what was shown, said, or never happened.
59 modelslast run Oct 25, 2026
66.2%
Seed 1.6
$0.039
Seed 1.6
64s
Seed 1.6
Quality66.2%
Seed 1.6
Value$0.039
Seed 1.6
Speed64s
Seed 1.6

Search

BenchmarkQualityValueSpeed

BrowseComp
Hard-to-locate facts on the live web, scored on persistent multi-step research.
4 modelslast run Aug 18, 2026
89.0%
Perplexity
Claude Opus 5 · high
$0.99
Perplexity
Claude Opus 5 · high
1.9m
Perplexity
Claude Opus 5 · high
Quality89.0%
Perplexity
Claude Opus 5 · high
Value$0.99
Perplexity
Claude Opus 5 · high
Speed1.9m
Perplexity
Claude Opus 5 · high
DeepSearchQA
Questions whose answers are lists, scored for exhaustive retrieval with no padding.
4 modelslast run Aug 18, 2026
77.0%
Parallel
Claude Opus 5 · high
$0.10
Perplexity
GPT-5.6 Luna · xhigh
1.6m
Perplexity
GPT-5.6 Luna · xhigh
Quality77.0%
Parallel
Claude Opus 5 · high
Value$0.10
Perplexity
GPT-5.6 Luna · xhigh
Speed1.6m
Perplexity
GPT-5.6 Luna · xhigh
HLE
Humanity's Last Exam as a search benchmark: expert questions answered with live search.
3 modelslast run Sep 15, 2026
77.4%
Perplexity
Claude Opus 5 · high
$0.16
Perplexity
Claude Opus 5 · high
48s
Perplexity
Claude Opus 5 · high
Quality77.4%
Perplexity
Claude Opus 5 · high
Value$0.16
Perplexity
Claude Opus 5 · high
Speed48s
Perplexity
Claude Opus 5 · high
WideSearch
Fill an entire table; answer-item accuracy scores partial matches.
4 modelslast run Aug 18, 2026
84.0%
Perplexity
GPT-5.6 Sol · high
$0.063
Perplexity
GPT-5.6 Luna · xhigh
1.9m
Perplexity
GPT-5.6 Sol · high
Quality84.0%
Perplexity
GPT-5.6 Sol · high
Value$0.063
Perplexity
GPT-5.6 Luna · xhigh
Speed1.9m
Perplexity
GPT-5.6 Sol · high

For usage-based views of the same models, see the model rankings and the full model list.