AI IQ
Subscribe

Reliability IQ Over Time

Each model's estimated Reliability IQ by release date. Step-lines connect each provider's flagship models over time.

Reliability IQ Over Time
Reliability IQ Over Time
The frontier by release date

How to read this chart

Each dot is a model with a known release date. Provider lines track public flagship releases over time and advance only when a newer model sets a higher Reliability IQ checkpoint for that provider.

Data sources
Epoch AI SimpleQA VerifiedArtificial AnalysisBullshitBench v2Artificial Analysis Intelligence Index v4.3.2Scale Labs MultiChallengeKaggle FACTS Grounding leaderboardARC PrizeEpoch AI FrontierMathProofBench 1.1MathArenaVals.aiManual source captureTIGER-Lab MMLU-Pro leaderboard (missing rows only)Vals.ai LiveCodeBenchVals.ai IOI V2Vals.ai ProgramBenchSWE-rebenchLLM StatsLLM Stats BrowseCompOSWorldLLM Stats OSWorld-VerifiedScale LabsScale Labs MCP AtlasArena.ai Agent ArenaAgents' Last Exam
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksAA Omniscience ScoresArtificial Analysis Omniscience scores for factual reliability. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksAA Long Context Reasoning v1.1 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Reliability using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksIFBench Benchmark ScoresInstruction-following and constraint-adherence scores. Color = provider.Data: Artificial Analysis, Artificial Analysis Intelligence Index v4.3.2Open chartIQ BenchmarksBullshitBench v2 ScoresClear Pushback rate: share of attempts where a model clearly challenges a false premise instead of accepting nonsense. Color = provider.Data: BullshitBench v2Open chartIQ BenchmarksSimpleQA Verified ScoresCorrect-answer rate on Epoch AI's verified factuality set. Color = provider.Data: Epoch AI SimpleQA VerifiedOpen chart