AI IQ
Subscribe

DeepSWE v1.1 Benchmark Scores

Each model's DeepSWE v1.1 Pass@1 score. Color = provider.

DeepSWE v1.1 Benchmark Scores
DeepSWE v1.1 Benchmark Scores
Each model's DeepSWE v1.1 Pass@1 score. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
DeepSWE v1.1
Data updated Sep 6, 2026
More / ExperimentalDeepSWE v1.1 vs Effective CostX = effective cost (log). Y = DeepSWE v1.1 %. Color = provider.Data: Artificial Analysis, ARC Prize, Vals Index v2 Cost per Test +2 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI, Epoch AI +26 moreOpen chartIQ BenchmarksARC-AGI-3 Benchmark ScoresEach model's ARC-AGI-3 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-2 ScoresEach model's ARC-AGI-2 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-1 Benchmark ScoresEach model's ARC-AGI-1 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksFrontierMath Tier 4 Benchmark ScoresEach model's FrontierMath Tier 4 score. Color = provider.Data: Epoch AI FrontierMathOpen chartIQ BenchmarksFrontierMath Tier 1-3 Benchmark ScoresEach model's FrontierMath Tier 1-3 score. Color = provider.Data: Epoch AI FrontierMathOpen chart