AI IQ
Subscribe

Reliability IQ vs Speed

Each model's estimated Reliability IQ against its completion time, which is time to last token (TTLT). Drag the input and output sliders to see how it changes with the workload.

Reliability IQ vs Speed
Reliability IQ vs Speed
Reliability IQ against completion time
Controls:
Input10K tok
Output1K tok
Reliability1:1Speed

How to read this chart

Each point is a public model's benchmark score against its estimated completion time (time to last token) for the input and output lengths set by the sliders. Timing comes from the site's per-model speed measurements, not from the benchmark run, so every point is an estimate and labels carry a ~ prefix. The newest generation with a published result is shown by default. Up and to the left is better.

Data sources
Epoch AI SimpleQA VerifiedArtificial AnalysisBullshitBench v2Artificial Analysis Intelligence Index v4.3.2Scale Labs MultiChallengeKaggle FACTS Grounding leaderboard
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksAA Omniscience ScoresArtificial Analysis Omniscience scores for factual reliability. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksAA Long Context Reasoning v1.1 ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Reliability using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksIFBench Benchmark ScoresInstruction-following and constraint-adherence scores. Color = provider.Data: Artificial Analysis, Artificial Analysis Intelligence Index v4.3.2Open chartIQ BenchmarksBullshitBench v2 ScoresClear Pushback rate: share of attempts where a model clearly challenges a false premise instead of accepting nonsense. Color = provider.Data: BullshitBench v2Open chartIQ BenchmarksSimpleQA Verified ScoresCorrect-answer rate on Epoch AI's verified factuality set. Color = provider.Data: Epoch AI SimpleQA VerifiedOpen chart