ARC-AGI-2 Cost Efficiency
X = ARC Prize reported cost/task (log). Y = ARC-AGI-2 %. Each line connects one model's published reasoning-effort levels, so the score-vs-cost tradeoff is visible per model. Defaults to the current model generation. Color = provider.
ARC-AGI-2 Cost Efficiency
X = ARC Prize reported cost/task (log). Y = ARC-AGI-2 %. Each line connects one model's published reasoning-effort levels, so the score-vs-cost tradeoff is visible per model. Defaults to the current model generation. Color = provider.
This chart is part of the ARC-AGI-2 benchmark page, which adds the model table, sources and how to read each view.
More / ExperimentalARC-AGI-2 vs Cost/TaskX = ARC Prize reported cost/task (log). Y = ARC-AGI-2 %. Shows all public model generations by default. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-2 ScoresEach model's ARC-AGI-2 score. Color = provider.Data: ARC PrizeOpen chartCostTask EfficiencyEach dot shows the inverse of the effective-cost usage multiplier. Higher means less price-adjusted task work: 2× is about half the median task effort. Source-backed multipliers are preferred; lineage, peer, and 1× fallbacks are labeled in tooltips.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +1 moreOpen chartCostIQ vs CostEach model's estimated IQ against its effective cost per 1M I/O Tokens (sticker price × measured or imputed usage multiplier).Data: AI IQ methodologyOpen chartMore / ExperimentalSWE-Bench Verified Benchmark ScoresHistorical data. Vals archived cohort; retired from default Software Engineering domain. Each model's SWE-Bench Verified score. Color = provider.Data: Vals.ai, LLM StatsOpen chartMore / ExperimentalTerminal-Bench 2.0 Benchmark ScoresHistorical data. Superseded by 2.1 and 4.0. Legacy Terminal-Bench 2.0 scores retained for historical comparison. Color = provider.Data: Terminal-BenchOpen chart