Rank #4
Model result · rank #4
Claude Opus 4.8
OpenRouter · extra-high reasoning. Public result card with the model’s overall score, lane measurements, runtime/cost telemetry, and ranking formula.
Full rank #8
SWE rank #2
100.0% reliability
All-around publication view
Score86.00
Formula50% Full + 50% SWE
BasisOpenRouter · extra-high reasoning
The overall score is calculated from the Full/Agentic and SWE lanes, keeping the aggregate comparable while preserving the measurements behind it.
Full / Agentic benchmark
Final83.32
Capability94.37
Agentic94.68
Pass rate93.0%
Prompts43
This lane captures instruction following, structured behavior, tool discipline, and general agentic reliability.
Software engineering MVP
SWE score88.67
Focused final84.92
Capability87.69
Daily driver83.74
Prompts24
This lane is closer to implementation usefulness: source handling, architecture cleanliness, and deliverable quality.
Runtime economics
Full cost$5.534
SWE cost$0.447
Full avg seconds11.65
SWE time209.77s
Decode29.80
Cost, time, and runtime basis are telemetry. They explain tradeoffs; they do not secretly overwrite the capability scores.
Interpretation
Why this result lands here.
The result is best read as a balanced benchmark entry: one overall score plus the lane measurements that produced it.