AI IQ
Subscribe

Mathematical Reasoning IQ vs Speed

Each model's estimated Mathematical Reasoning IQ against its completion time, which is time to last token (TTLT). Drag the input and output sliders to see how it changes with the workload.

Mathematical Reasoning IQ vs Speed
Mathematical Reasoning IQ vs Speed
Mathematical Reasoning IQ against completion time
Controls:
Input10K tok
Output1K tok
Mathematical Reasoning1:1Speed

How to read this chart

Each point is a public model's benchmark score against its estimated completion time (time to last token) for the input and output lengths set by the sliders. Timing comes from the site's per-model speed measurements, not from the benchmark run, so every point is an estimate and labels carry a ~ prefix. The newest generation with a published result is shown by default. Up and to the left is better.

Data sources
Epoch AI FrontierMathProofBench 1.1MathArenaVals.aiArtificial Analysis
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksFrontierMath Tier 1-3 Benchmark ScoresEach model's FrontierMath Tier 1-3 score. Color = provider.Data: Epoch AI FrontierMathOpen chartIQ BenchmarksFrontierMath Tier 4 Benchmark ScoresEach model's FrontierMath Tier 4 score. Color = provider.Data: Epoch AI FrontierMathOpen chartIQ BenchmarksAIME Benchmark ScoresEach model's AIME score. Color = provider.Data: Vals.ai, Artificial AnalysisOpen chartIQ BenchmarksMathArena Benchmark ScoresEach model's MathArena expected performance. Color = provider.Data: MathArenaOpen chartIQ BenchmarksProofBench 1.1 ScoresNative Lean 4.25.2 verification including native_decide. Version 1.1 only; not comparable to the unversioned historical cohort. Contributes to Mathematical Reasoning using a provisional calibrated scale.Data: ProofBench 1.1Open chart