Toolathlon
A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.
About Toolathlon
What Toolathlon measures
Archived benchmark. Historical results combine original and Verified cohorts and are excluded from IQ. Retained for reference; scores are not a consistent current-model comparison.
Reading the cost view
Toolathlon publishes no per-run cost, so this chart falls back to each model's estimated effective cost per 1M I/O tokens (a runtime estimate from measured or imputed token usage, not a published task cost). Explicit reasoning/nonreasoning siblings are connected where both are public; every other model is a standalone point. Up and to the left is better.
Reading the completion-time view
Each point is a public model's Toolathlon score against its estimated completion time (time to last token) for the input and output lengths set by the sliders. Timing comes from the site's per-model speed measurements, not from the benchmark run, so every point is an estimate and labels carry a ~ prefix. The newest generation with a published result is shown by default. Up and to the left is better.
Reading the score bars
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.