AI IQ
Subscribe

Backend Engineering IQ

Each model's Backend Engineering IQ plotted on a standard normal IQ distribution

Backend Engineering IQ
Backend Engineering IQ
Each model's Backend Engineering IQ plotted on a standard normal IQ distribution
Controls:

How to read this chart

Models are placed on a standard IQ-style distribution using Backend Engineering IQ. Higher scores appear farther to the right.

Benchmarks in this dimension

SWE-Bench VerifiedLiveCodeBenchSWE-Bench ProAPEX-SWEDeepSWEFrontierSWEFrontierCode DiamondSWE-rebenchDeepSWE v1.1SWE Marathon
Backend Engineering vs Effective Cost
Backend Engineering vs Effective Cost
X = effective cost (log). Y = Backend Engineering IQ. Color = provider.
Controls:
Production Eng.1:1Cost

How to read this chart

Each point is a public model. The chart compares Backend Engineering IQ against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

Data sources
Artificial AnalysisARC PrizeVals.aiCognition FrontierCodeMercor APEX-SWELLM StatsScale LabsScale Labs SWE-Bench Pro Public DatasetDeepSWE v1.1DeepSWESWE-rebenchSWE Marathon
CoreAI Models on the IQ Bell CurveEach model's estimated IQ plotted on a standard normal IQ distributionData: ARC Prize, Epoch AI FrontierMath, Vals.ai +25 moreOpen chartIQ BenchmarksSWE-Bench Verified Benchmark ScoresEach model's SWE-Bench Verified score. Color = provider.Data: Vals.ai, LLM StatsOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.aiOpen chartIQ BenchmarksSWE-Bench Pro Benchmark ScoresEach model's SWE-Bench Pro percentage score. Color = provider.Data: Scale Labs, Scale Labs SWE-Bench Pro Public DatasetOpen chartIQ BenchmarksAPEX-SWE ScoresMercor APEX-SWE overall Pass@1 scores for economically valuable software-engineering work. Color = provider.Data: Mercor APEX-SWEOpen chartIQ BenchmarksDeepSWE Benchmark ScoresEach model's DeepSWE Pass@1 score. Color = provider.Data: DeepSWEOpen chart