Code Migration Scores
Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset. Contributes to Software Engineering using a provisional calibrated scale.
Code Migration Scores
Code Migration Scores
Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset. Contributes to Software Engineering using a provisional calibrated scale.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
Code Migration vs Effective Cost
Code Migration vs Effective Cost
X = effective cost (log). Y = Code Migration. Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset.
Controls:
How to read this chart
Each point is a public model. The chart compares Code Migration (%) against Effective Cost (per 1M I/O Tokens), with color showing the model provider.
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +24 moreOpen chartCoreIQ vs EQX = diagnostic EQ. Y = IQ. Color = model provider.Data: EQ-Bench 4 Elo, EQ-Bench 3, AttuneBench +27 moreOpen chartCostIQ vs Effective CostEach model's estimated IQ against its effective cost per 1M I/O Tokens (sticker price × measured or imputed usage multiplier).Data: AI IQ methodologyOpen chartCoreIQ Over TimeEach model's estimated IQ by release date. Step-lines connect each provider's flagship models over time.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +24 moreOpen chartCoreIQ vs EQ vs Cost in 3D3D scatter: X = diagnostic EQ, Y = IQ, Z = effective cost (log). Color = provider. Drag to rotate.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +1 moreOpen chartResponse TimeIQ vs Completion Time vs Cost in 3D3D scatter: X = completion time (time to last token, TTLT; log, faster to the right), Y = IQ, Z = effective cost (log). Color = provider. Drag to rotate.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +1 moreOpen chart