IOI V2 Scores
2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1. Contributes to Programmatic Reasoning using a provisional calibrated scale.
IOI V2 Scores
IOI V2 Scores
2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1. Contributes to Programmatic Reasoning using a provisional calibrated scale.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
IOI V2 vs Effective Cost
IOI V2 vs Effective Cost
X = effective cost (log). Y = IOI V2. 2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1.
Controls:
How to read this chart
Each point is a public model. The chart compares IOI V2 (%) against Effective Cost (per 1M I/O Tokens), with color showing the model provider.
IQ DimensionsProgrammatic Reasoning IQEach model's Programmatic Reasoning IQ plotted on a standard normal IQ distributionData: Vals.ai, Vals.ai LiveCodeBench, Vals.ai IOI +4 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksTerminal-Bench 4.0 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.ai, Vals.ai LiveCodeBenchOpen chartIQ BenchmarksProgramBench ScoresAlmost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.Data: Vals.ai ProgramBenchOpen chartIQ BenchmarksSWE-rebench Benchmark ScoresEach model's SWE-rebench resolved rate. Color = provider.Data: SWE-rebenchOpen chart