Animating Cost over IQ vs EQ
X = diagnostic EQ. Y = IQ. Cost/10K queries shown as bills over a 10s period.
Animating Cost over IQ vs EQ
Animating Cost over IQ vs EQ
X = diagnostic EQ. Y = IQ. Cost/10K queries shown as bills over a 10s period.
Controls:
How to read this chart
Animated bills show relative spend over time while the axes compare quality, cost, or response speed.
Data sources
Arena.aiEQ-Bench 3AttuneBenchARC PrizeEpoch AI FrontierMathVals.aiArtificial AnalysisMathArenaArena.ai WebDevDesignArena FrontendDesignArena Full StackVals.ai Vibe Code BenchVals.ai Vibe Code Bench v1.1LLM StatsScale LabsScale Labs SWE-Bench Pro Public DatasetDeepSWE v1.1DeepSWESWE MarathonMercor APEX-SWECognition FrontierCodeSWE-rebenchArtificial Analysis Terminal-Bench v2.1Vals.ai Terminal-Bench 2.1OSWorldLLM Stats OSWorld-VerifiedToolathlonLLM Stats ToolathlonScale LabsScale Labs MCP AtlasAgents' Last ExamBullshitBench v2Kaggle FACTS Grounding leaderboard
More / ExperimentalTerminal-Bench 2.0 Benchmark ScoresLegacy Terminal-Bench 2.0 scores retained for historical comparison. Color = provider.Data: Terminal-BenchOpen chartMore / ExperimentalARC-AGI-3 Cost EfficiencyX = ARC Prize reported Cost (V3) (log). Y = ARC-AGI-3 %. Each line connects one model's published reasoning-effort levels, so the score-vs-cost tradeoff is visible per model. Defaults to the current model generation. Color = provider.Data: ARC PrizeOpen chartMore / ExperimentalARC-AGI-2 Cost EfficiencyX = ARC Prize reported cost/task (log). Y = ARC-AGI-2 %. Each line connects one model's published reasoning-effort levels, so the score-vs-cost tradeoff is visible per model. Defaults to the current model generation. Color = provider.Data: ARC PrizeOpen chartMore / ExperimentalARC-AGI-1 Cost EfficiencyX = ARC Prize reported cost/task (log). Y = ARC-AGI-1 %. Each line connects one model's published reasoning-effort levels, so the score-vs-cost tradeoff is visible per model. Defaults to the current model generation. Color = provider.Data: ARC PrizeOpen chartMore / ExperimentalBenchmark Correlation HeatmapA pairwise matrix of source-backed benchmark score correlations across public models. Color shows Pearson r; each cell uses models with both benchmark scores.Data: ARC Prize, Epoch AI FrontierMath, Vals.ai +30 moreOpen chartMore / ExperimentalFlagship Lab Benchmark Correlation HeatmapA pairwise benchmark correlation matrix using only the latest flagship model from each major US and Chinese lab.Data: ARC Prize, Epoch AI FrontierMath, Vals.ai +30 moreOpen chart