Reliability IQ
Each model's Reliability IQ plotted on a standard normal IQ distribution
Reliability IQ
Reliability IQ
Each model's Reliability IQ plotted on a standard normal IQ distribution
How to read this chart
Models are placed on a standard IQ-style distribution using Reliability IQ. Higher scores appear farther to the right.
Benchmarks in this dimension
Reliability vs Effective Cost
Reliability vs Effective Cost
X = effective cost (log). Y = Reliability IQ. Color = provider.
Controls:
How to read this chart
Each point is a public model. The chart compares Reliability IQ against Effective Cost (per 1M I/O Tokens), with color showing the model provider.
Data sources
Artificial AnalysisARC PrizeVals.aiEpoch AI SimpleQA VerifiedBullshitBench v2Scale Labs MultiChallengeKaggle FACTS Grounding leaderboard
CoreAI Models on the IQ Bell CurveEach model's estimated IQ plotted on a standard normal IQ distributionData: ARC Prize, Epoch AI FrontierMath, Vals.ai +24 moreOpen chartIQ BenchmarksAA Long Chain Reasoning ScoresArtificial Analysis Long Chain Reasoning scores for long-document extraction, synthesis, and reasoning. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksAA Omniscience ScoresArtificial Analysis Omniscience scores for factual reliability. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksIFBench Benchmark ScoresInstruction-following and constraint-adherence scores. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksBullshitBench v2 ScoresClear Pushback rate: share of attempts where a model clearly challenges a false premise instead of accepting nonsense. Color = provider.Data: BullshitBench v2Open chartIQ BenchmarksSimpleQA Verified ScoresCorrect-answer rate on Epoch AI's verified factuality set. Color = provider.Data: Epoch AI SimpleQA VerifiedOpen chart