AA Long Context Reasoning v1.1 Scores
Exact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Reliability using a provisional calibrated scale.
AA Long Context Reasoning v1.1 Scores
Exact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Reliability using a provisional calibrated scale.
AA Long Context Reasoning v1.1 Cost Efficiency
Source-matched reasoning-effort score and task-cost configurations. Each line is one canonical model. Color = provider.
This chart is part of the AA Long Context Reasoning v1.1 benchmark page, which adds the model table, sources and how to read each view.
IQ DimensionsReliability IQ Bell CurveEach model's estimated Reliability IQ, placed on a standard normal IQ distribution.Data: Full source leaderboard reconciliation, Artificial Analysis, Full source leaderboard reconciliation +2 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +26 moreOpen chartIQ BenchmarksAA Omniscience ScoresArtificial Analysis Omniscience scores for factual reliability. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksIFBench Benchmark ScoresInstruction-following and constraint-adherence scores. Color = provider.Data: Artificial Analysis, Artificial Analysis Intelligence Index v4.3.2Open chartIQ BenchmarksBullshitBench v2 ScoresClear Pushback rate: share of attempts where a model clearly challenges a false premise instead of accepting nonsense. Color = provider.Data: Full source leaderboard reconciliationOpen chartIQ BenchmarksSimpleQA Verified ScoresCorrect-answer rate on Epoch AI's verified factuality set. Color = provider.Data: Full source leaderboard reconciliationOpen chart