IOI

A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.

About IOI

IOI measures competitive-programming accuracy across the 2024 and 2025 International Olympiad in Informatics tasks. The efficiency view compares each published configuration with effective cost.

IOI Cost Efficiency
IOI accuracy versus runtime effective cost. Explicit reasoning and nonreasoning variants are connected; other published configurations remain standalone points. Color = provider.

How to read this chart

This chart compares source-backed IOI configurations with runtime effective cost. Multiple reasoning levels for the same model are connected; models with one available level remain standalone points. Up and to the left is better.

IOI Benchmark Scores
Vals.ai accuracy across the 2024 and 2025 International Olympiad in Informatics tasks. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
IOI vs Effective Cost
X = effective cost (log). Y = IOI accuracy. Color = provider.
Controls:
IOI1:1Cost

How to read this chart

Each point is a public model. The chart compares IOI accuracy against Effective Cost (per 1M I/O Tokens), with color showing the model provider.