Mathematical Reasoning

A bird's-eye view of the dimension: the main IQ chart, the effective-cost frontier, and the benchmark charts that feed it.

Mathematical Reasoning IQ
Each model's Mathematical Reasoning IQ plotted on a standard normal IQ distribution
Controls:

How to read this chart

Models are placed on a standard IQ-style distribution using Mathematical Reasoning IQ. Higher scores appear farther to the right.

Benchmarks in this dimension

Mathematical Reasoning vs Effective Cost
X = effective cost (log). Y = Mathematical Reasoning IQ. Color = provider.
Controls:
Math1:1Cost

How to read this chart

Each point is a public model. The chart compares Mathematical Reasoning IQ against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

AIME Benchmark Scores
Each model's AIME score. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

FrontierMath Tier 1-3 Benchmark Scores
Each model's FrontierMath Tier 1-3 score. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

FrontierMath Tier 4 Benchmark Scores
Each model's FrontierMath Tier 4 score. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

MathArena Benchmark Scores
Each model's MathArena expected performance. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
ProofBench Benchmark Scores
Each model's ProofBench score. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources