ProgramBench Scores
Almost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.
ProgramBench Scores
ProgramBench Scores
Almost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
Data sources
IQ DimensionsProgrammatic Reasoning IQEach model's Programmatic Reasoning IQ plotted on a standard normal IQ distributionData: Vals.ai, Vals.ai IOI, Artificial Analysis Terminal-Bench v2.1 +4 moreOpen chartCoreAI Models on the IQ Bell CurveEach model's estimated IQ plotted on a standard normal IQ distributionData: ARC Prize, Epoch AI Chess Puzzles, Epoch AI FrontierMath +25 moreOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.aiOpen chartIQ BenchmarksTerminal-Bench 2.1 Benchmark ScoresEach model's Terminal-Bench 2.1 pass@1 score, using Artificial Analysis as canonical and Vals.ai as fallback. Color = provider.Data: Artificial Analysis Terminal-Bench v2.1, Vals.ai Terminal-Bench 2.1Open chartIQ BenchmarksIOI Benchmark ScoresVals.ai accuracy across the 2024 and 2025 International Olympiad in Informatics tasks. Color = provider.Data: Vals.ai IOIOpen chartIQ BenchmarksSWE-rebench Benchmark ScoresEach model's SWE-rebench resolved rate. Color = provider.Data: SWE-rebenchOpen chart