Terminal-Bench 4.0 Scores
Exact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.
Terminal-Bench 4.0 Scores
Terminal-Bench 4.0 Scores
Exact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Programmatic Reasoning using a provisional calibrated scale.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
Terminal-Bench 4.0 vs Effective Cost
Terminal-Bench 4.0 vs Effective Cost
X = effective cost (log). Y = Terminal-Bench 4.0. Exact AA v4.3.2 model/configuration; never substitute older benchmark versions.
Controls:
How to read this chart
Each point is a public model. The chart compares Terminal-Bench 4.0 (%) against Effective Cost (per 1M I/O Tokens), with color showing the model provider.
IQ DimensionsProgrammatic Reasoning IQEach model's Programmatic Reasoning IQ plotted on a standard normal IQ distributionData: Vals.ai, Vals.ai LiveCodeBench, Vals.ai IOI +4 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +24 moreOpen chartIQ BenchmarksLiveCodeBench Benchmark ScoresEach model's LiveCodeBench score. Color = provider.Data: Vals.ai, Vals.ai LiveCodeBenchOpen chartIQ BenchmarksProgramBench ScoresAlmost Resolved score: share of ProgramBench tasks passing at least 95% of hidden tests. Color = provider.Data: Vals.ai ProgramBenchOpen chartIQ BenchmarksIOI Benchmark ScoresVals.ai accuracy across the 2024 and 2025 International Olympiad in Informatics tasks. Color = provider.Data: Vals.ai IOIOpen chartIQ BenchmarksSWE-rebench Benchmark ScoresEach model's SWE-rebench resolved rate. Color = provider.Data: SWE-rebenchOpen chart