Model result, rank 19 of 27

GPT‑6 Sol

ChatGPT Codex subscription · extra-high reasoning · Full + SWE + Hard measured. Public result card with the model’s overall score, lane measurements, runtime and cost telemetry, and the ranking formula.

Compare all models Download public JSON

Figure 1 Lane profile against the cohort Each bar is one measured lane on the shared 0 to 100 scale. The thin mark is the cohort median; the bright mark is the best score any ranked model reached on that lane.

Full / Agenticlane rank #9 of 27

83.13

SWE MVPlane rank #25 of 27

52.56

Hard Intelligencelane rank #6 of 27

92.59

GPT‑6 Sol
Cohort median
Cohort best

Overall score76.09

Rank #19

Full / Agentic83.13

Full rank #9

SWE MVP52.56

SWE rank #25

Hard Intelligence92.59

Hard rank #6

Measured cost$1.310

100.0% reliability

Overall

All-around publication view

Score76.09

Formulamean(Full, SWE, Hard Intelligence)

BasisChatGPT Codex subscription · extra-high reasoning · Full + SWE + Hard measured

The overall score averages the measured major lanes while keeping each source measurement visible.

Lane 01

Full / Agentic benchmark

Final83.13

Capability99.37

Agentic94.83

Pass rate100.0%

Prompts43

This lane captures instruction following, structured behavior, tool discipline, and general agentic reliability.

Lane 02

Software engineering MVP

SWE score52.56

Focused final53.68

Capability41.95

Daily driver57.05

Prompts24

This lane is closer to implementation usefulness: source handling, architecture cleanliness, and deliverable quality.

Lane 03

Hard Intelligence diagnostic

Hard score92.59

Active inquiry99.75

Online adaptation97.63

Self-repair85.48

Authority integrity87.50

Hard Intelligence measures active inquiry, online adaptation, evidence-driven self-repair, and authority/salience integrity.

Telemetry

Runtime economics

Total cost$1.310

Cost / scored item$0.016

Seconds / timed item12.11s

Runtime coverage100.0%

Recorded tokens / item6.8k

Token coverage100.0%

Cost, time, and token basis are normalized telemetry. They explain tradeoffs; they do not overwrite the capability score yet.

Interpretation

Why the result lands here.

The model is stronger in the Full/Agentic lane than in the SWE lane; the overall score is therefore shown with both component lanes visible. Hard Intelligence score is 92.59 and contributes to the overall score alongside Full/Agentic and SWE. Runs on the ChatGPT Codex subscription; the transport is the Codex Responses route rather than a metered API key. Reasoning effort is extra-high on every lane, matching the published extra-high baselines. The model also accepts a higher effort level that was not used here. Costed at the model’s published Standard API rates ($2.00/1M input, $10.00/1M output) as a comparable basis, not an invoice: the subscription bills no marginal per-token charge. Hard Intelligence is a public diagnostic, not a hidden official score. Token median and P90 per scored item are intentionally omitted: their derivation could not be reproduced on the same basis as the published rows. Full long-context probe rescored under suite v4 (ambiguous probe: silent under literal compliance).