AI IQ
Subscribe

Programmatic Reasoning IQ Over Time

Each model's estimated Programmatic Reasoning IQ by release date. Step-lines connect each provider's flagship models over time.

Programmatic Reasoning IQ Over Time
Programmatic Reasoning IQ Over Time
The frontier by release date

How to read this chart

Each dot is a model with a known release date. Provider lines track public flagship releases over time and advance only when a newer model sets a higher Programmatic Reasoning IQ checkpoint for that provider.

Data sources
Vals.aiVals.ai LiveCodeBenchVals.ai IOIArtificial AnalysisVals.ai ProgramBenchFrontierSWESWE-rebenchARC PrizeEpoch AI FrontierMathProofBench 1.1MathArenaArtificial Analysis Intelligence Index v4.3.2Manual source captureTIGER-Lab MMLU-Pro leaderboard (missing rows only)Vals.ai IOI V2LLM StatsLLM Stats BrowseCompOSWorldLLM Stats OSWorld-VerifiedScale LabsScale Labs MCP AtlasArena.ai Agent ArenaAgents' Last ExamEpoch AI SimpleQA VerifiedBullshitBench v2Kaggle FACTS Grounding leaderboard
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksTerminal-Bench 4.0 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.ai, Vals.ai LiveCodeBenchOpen chartIQ BenchmarksProgramBench ScoresAlmost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.Data: Vals.ai ProgramBenchOpen chartIQ BenchmarksIOI V2 Scores2024–2026 olympiad tasks, no interactive grading feedback. Version 2 only; separately calibrated from archived V1. Contributes to Programmatic Reasoning using a provisional calibrated scale.Data: Vals.ai IOI V2Open chartIQ BenchmarksSWE-rebench Benchmark ScoresEach model's SWE-rebench resolved rate. Color = provider.Data: SWE-rebenchOpen chart