SWE-rebench Benchmark Scores
Each model's SWE-rebench resolved rate. Color = provider.
SWE-rebench Benchmark Scores
Each model's SWE-rebench resolved rate. Color = provider.
SWE-rebench Cost Efficiency
Source-matched reasoning-effort score and task-cost configurations. Each line is one canonical model. Color = provider.
This chart is part of the SWE-rebench benchmark page, which adds the model table, sources and how to read each view.
IQ DimensionsProgrammatic Reasoning IQ Bell CurveEach model's estimated Programmatic Reasoning IQ, placed on a standard normal IQ distribution.Data: Vals.ai, Vals.ai LiveCodeBench, Vals.ai IOI V2 +4 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI, Epoch AI +26 moreOpen chartIQ BenchmarksTerminal-Bench 4.0 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.ai, Vals.ai LiveCodeBenchOpen chartIQ BenchmarksProgramBench ScoresAlmost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.Data: Vals.ai ProgramBenchOpen chartIQ BenchmarksIOI V2 Scores2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Vals.ai IOI V2Open chart