AI IQ
Subscribe

Programmatic Reasoning IQ vs Speed

Each model's estimated Programmatic Reasoning IQ against its completion time, which is time to last token (TTLT). Drag the input and output sliders to see how it changes with the workload.

Programmatic Reasoning IQ vs Speed
Programmatic Reasoning IQ vs Speed
Programmatic Reasoning IQ against completion time
Controls:
Input10K tok
Output1K tok
Programmatic Reasoning1:1Speed

How to read this chart

Each point is a public model's benchmark score against its estimated completion time (time to last token) for the input and output lengths set by the sliders. Timing comes from the site's per-model speed measurements, not from the benchmark run, so every point is an estimate and labels carry a ~ prefix. The newest generation with a published result is shown by default. Up and to the left is better.

Data sources
Vals.aiVals.ai LiveCodeBenchVals.ai IOIArtificial AnalysisVals.ai ProgramBenchFrontierSWESWE-rebench
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksTerminal-Bench 4.0 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.ai, Vals.ai LiveCodeBenchOpen chartIQ BenchmarksProgramBench ScoresAlmost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.Data: Vals.ai ProgramBenchOpen chartIQ BenchmarksIOI V2 Scores2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Vals.ai IOI V2Open chartIQ BenchmarksSWE-rebench Benchmark ScoresEach model's SWE-rebench resolved rate. Color = provider.Data: SWE-rebenchOpen chart