AI IQ
Subscribe

Programmatic Reasoning

A bird's-eye view of the dimension: the main IQ chart, the effective-cost frontier, and the benchmark charts that feed it.

Programmatic Reasoning IQ Bell Curve
Programmatic Reasoning IQ Bell Curve
Each model's estimated Programmatic Reasoning IQ, placed on a standard normal IQ distribution.

How to read this chart

Models are placed on a standard IQ-style distribution using Programmatic Reasoning IQ. Higher scores appear farther to the right.

Benchmarks in this dimension

Terminal-Bench 4.0LiveCodeBenchProgramBenchIOI V2SWE-rebenchMirrorCode
Programmatic Reasoning IQ vs Cost
Programmatic Reasoning IQ vs Cost
Each model's estimated Programmatic Reasoning IQ against its effective cost per 1M I/O Tokens (sticker price × measured or imputed usage multiplier).
Controls:
Programmatic1:1Cost

How to read this chart

Each point is a public model. The chart compares Programmatic Reasoning IQ against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

Data sources
Artificial AnalysisARC PrizeVals Index v2 Cost per TestVals.aiFull source leaderboard reconciliationFull source leaderboard reconciliationFull source leaderboard reconciliationSWE-rebenchFull source leaderboard reconciliation
Benchmarks In This Dimension
Terminal-Bench 4.0 Scores
Exact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
Artificial Analysis
Data updated Oct 19, 2026
LiveCodeBench Benchmark Scores
Each model's LiveCodeBench score. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
Vals.aiFull source leaderboard reconciliation
Data updated Sep 14, 2026
ProgramBench Scores
Almost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
Full source leaderboard reconciliation
Data updated Oct 13, 2026
IOI V2 Scores
2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1. Contributes to Programmatic Reasoning using a provisional calibrated scale.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
Full source leaderboard reconciliation
Data updated Oct 13, 2026
SWE-rebench Benchmark Scores
Each model's SWE-rebench resolved rate. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
SWE-rebench
Data updated Sep 22, 2026
MirrorCode Scores
Epoch ML,+Private,2L: 30 tasks, three repeats, seven days and 10B tokens per attempt. Average rate of completely solved programs; distinct from the paper cohort. Contributes to Programmatic Reasoning using a provisional calibrated scale.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
Full source leaderboard reconciliation
Data updated Sep 29, 2026