Abstract Reasoning IQ vs Speed
Each model's estimated Abstract Reasoning IQ against its completion time, which is time to last token (TTLT). Drag the input and output sliders to see how it changes with the workload.
Abstract Reasoning IQ vs Speed
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +27 moreOpen chartIQ BenchmarksARC-AGI-2 ScoresEach model's ARC-AGI-2 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-1 Benchmark ScoresEach model's ARC-AGI-1 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksChess Puzzles ScoresEpoch’s 100 novel chess positions, presented as text (FEN). Exact best-next-move accuracy; no vision input. Chess knowledge and planning both contribute. Contributes to Abstract Reasoning using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chartIQ BenchmarksMystery Game Puzzles ScoresEpoch’s 100 text-state puzzles in an undisclosed game. Best-next-move accuracy in a minimal agent scaffold; invalid or missing moves receive no credit. Prompts and transcripts are private. Contributes to Abstract Reasoning using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chartIQ BenchmarksARC-AGI-3 Benchmark ScoresEach model's ARC-AGI-3 score. Color = provider.Data: ARC PrizeOpen chart