AI IQ

Reliability IQ

Each model's Reliability IQ plotted on a standard normal IQ distribution

Reliability IQ
Reliability IQ
Each model's Reliability IQ plotted on a standard normal IQ distribution
Controls:

How to read this chart

Models are placed on a standard IQ-style distribution using Reliability IQ. Higher scores appear farther to the right.

Benchmarks in this dimension

AA Long Chain ReasoningAA OmniscienceIFBenchBullshitBench v2FACTS Grounding
Reliability vs Effective Cost
Reliability vs Effective Cost
X = effective cost (log). Y = Reliability IQ. Color = provider.
Controls:
Reliability1:1Cost

How to read this chart

Each point is a public model. The chart compares Reliability IQ against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

Data sources
Artificial AnalysisARC PrizeVals.aiBullshitBench v2Kaggle FACTS Grounding leaderboard
CoreAI Models on the IQ Bell CurveEach model's estimated IQ plotted on a standard normal IQ distributionData: ARC Prize, Epoch AI FrontierMath, Vals.ai +27 moreOpen chartIQ BenchmarksAA Long Chain Reasoning ScoresArtificial Analysis Long Chain Reasoning scores for long-document extraction, synthesis, and reasoning. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksAA Omniscience ScoresArtificial Analysis Omniscience scores for factual reliability. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksIFBench Benchmark ScoresInstruction-following and constraint-adherence scores. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksBullshitBench v2 ScoresClear Pushback rate: share of attempts where a model clearly challenges a false premise instead of accepting nonsense. Color = provider.Data: BullshitBench v2Open chartIQ BenchmarksFACTS Grounding ScoresGoogle FACTS Grounding scores for long-form responses fully grounded in provided documents. Color = provider.Data: Kaggle FACTS Grounding leaderboardOpen chart