Arena.ai Overall Benchmark Scores
Human-preference Arena.ai Overall Elo scores. Color = provider.
Arena.ai Overall Benchmark Scores
More / ExperimentalArena.ai Overall Elo vs CostX = effective cost (log). Y = Arena.ai Overall Elo. Color = provider.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +2 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI, Epoch AI +26 moreOpen chartEmotional & InteractionEmotional Reasoning IQ Bell CurveEach model's Emotional Reasoning IQ, derived from EQ-Bench 4 and AttuneBench and excluded from Composite IQ, placed on a standard normal IQ distribution.Data: EQ-Bench 4 Elo, EQ-Bench 3, AttuneBenchOpen chartEmotional & InteractionEQ-Bench 3 Benchmark ScoresAI-judged EQ-Bench 3 Elo, a style-sensitive emotional reasoning signal. Color = provider.Data: EQ-Bench 3Open chartEmotional & InteractionAttuneBench Benchmark ScoresDefault-mode AttuneBench Composite scores from real human-AI conversations. Color = provider.Data: AttuneBenchOpen chartEmotional & InteractionEQ-Bench 4 Elo ScoresPublished multi-judge Elo on 120 personas and 16 turns. No inherited EQ-Bench 3 Anthropic penalty. Subjective roleplay evaluation; not a validated human EI measure. Contributes to Emotional Reasoning using a provisional calibrated scale.Data: EQ-Bench 4 EloOpen chartCoreIQ vs EQX = diagnostic EQ. Y = IQ. Color = model provider.Data: EQ-Bench 4 Elo, EQ-Bench 3, AttuneBench +29 moreOpen chart