AI IQ
Subscribe

SimpleQA Verified Scores

Correct-answer rate on Epoch AI's verified factuality set. Color = provider.

SimpleQA Verified Scores
SimpleQA Verified Cost Efficiency
X-axis
Effective cost (est.)Completion time (est.)

This chart is part of the SimpleQA Verified benchmark page, which adds the model table, sources and how to read each view.

IQ DimensionsReliability IQ Bell CurveEach model's estimated Reliability IQ, placed on a standard normal IQ distribution.Data: Full source leaderboard reconciliation, Artificial Analysis, Full source leaderboard reconciliation +2 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +26 moreOpen chartIQ BenchmarksAA Omniscience ScoresArtificial Analysis Omniscience scores for factual reliability. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksAA Long Context Reasoning v1.1 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Reliability using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksIFBench Benchmark ScoresInstruction-following and constraint-adherence scores. Color = provider.Data: Artificial Analysis, Artificial Analysis Intelligence Index v4.3.2Open chartIQ BenchmarksBullshitBench v2 ScoresClear Pushback rate: share of attempts where a model clearly challenges a false premise instead of accepting nonsense. Color = provider.Data: Full source leaderboard reconciliationOpen chart