Code Migration Scores
Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset. Contributes to Software Engineering using a provisional calibrated scale.
Code Migration Scores
More / ExperimentalCode Migration vs Effective CostX = effective cost (log). Y = Code Migration. Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +2 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI, Epoch AI +26 moreOpen chartCoreIQ vs EQX = diagnostic EQ. Y = IQ. Color = model provider.Data: EQ-Bench 4 Elo, EQ-Bench 3, AttuneBench +29 moreOpen chartCostIQ vs CostEach model's estimated IQ against its effective cost per 1M I/O Tokens (sticker price × measured or imputed usage multiplier).Data: AI IQ methodologyOpen chartCoreIQ Over TimeEach model's estimated IQ by release date. Step-lines connect each provider's flagship models over time.Data: ARC Prize, Epoch AI, Epoch AI +26 moreOpen chartCoreIQ vs EQ vs Cost in 3D3D scatter: X = diagnostic EQ, Y = IQ, Z = effective cost (log). Color = provider. Drag to rotate.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +1 moreOpen chartResponse TimeIQ vs Completion Time vs Cost in 3D3D scatter: X = completion time (time to last token, TTLT; log, faster to the right), Y = IQ, Z = effective cost (log). Color = provider. Drag to rotate.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +1 moreOpen chart