Abstract Reasoning IQ Over Time
Each model's estimated Abstract Reasoning IQ by release date. Step-lines connect each provider's flagship models over time.
Abstract Reasoning IQ Over Time
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +27 moreOpen chartIQ BenchmarksARC-AGI-2 ScoresEach model's ARC-AGI-2 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-1 Benchmark ScoresEach model's ARC-AGI-1 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksChess Puzzles ScoresEpoch’s 100 novel chess positions, presented as text (FEN). Exact best-next-move accuracy; no vision input. Chess knowledge and planning both contribute. Contributes to Abstract Reasoning using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chartIQ BenchmarksMystery Game Puzzles ScoresEpoch’s 100 text-state puzzles in an undisclosed game. Best-next-move accuracy in a minimal agent scaffold; invalid or missing moves receive no credit. Prompts and transcripts are private. Contributes to Abstract Reasoning using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chartIQ BenchmarksARC-AGI-3 Benchmark ScoresEach model's ARC-AGI-3 score. Color = provider.Data: ARC PrizeOpen chart