Rank #17
Model result · rank #17
NVIDIA Nemotron 3 Ultra
OpenRouter · nvidia/nemotron-3-ultra-550b-a55b · extra-high reasoning. Public result card with the model’s overall score, lane measurements, runtime/cost telemetry, and ranking formula.
Full rank #17
SWE rank #16
Hard rank #16
100.0% reliability
All-around publication view
Score67.58
Formulamean(Full, SWE, Hard Intelligence)
BasisOpenRouter · nvidia/nemotron-3-ultra-550b-a55b · extra-high reasoning
The overall score averages the measured major lanes while keeping each source measurement visible.
Full / Agentic benchmark
Final79.54
Capability95.29
Agentic92.57
Pass rate93.0%
Prompts43
This lane captures instruction following, structured behavior, tool discipline, and general agentic reliability.
Software engineering MVP
SWE score58.63
Focused final60.73
Capability58.63
Daily driver60.63
Prompts24
This lane is closer to implementation usefulness: source handling, architecture cleanliness, and deliverable quality.
Hard Intelligence diagnostic
Hard score64.56
Active inquiry93.08
Online adaptation8.75
Self-repair56.40
Authority integrity100.00
Hard Intelligence measures active inquiry, online adaptation, evidence-driven self-repair, and authority/salience integrity.
Runtime economics
Total cost$0.489
Cost / scored item$0.0065
Seconds / timed item70.71s
Runtime coverage100.0%
Recorded tokens / item8.8k
Token coverage100.0%
Cost, time, and token basis are normalized telemetry. They explain tradeoffs; they do not overwrite the capability score yet.
Interpretation
Why this result lands here.
The model is stronger in the Full/Agentic lane than in the SWE lane; the overall score is therefore shown with both component lanes visible. Hard Intelligence score is 64.56 and contributes to the overall score alongside Full/Agentic and SWE. Hard Intelligence is published alongside Full/Agentic and SWE for the current ranking.