AI IQ
Subscribe

ProofBench 1.1

A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.

About ProofBench 1.1

ProofBench 1.1 does not yet have two source-matched reasoning-effort score/cost rows for one model. The Cost Efficiency surface is reserved at the top of this page and will populate when qualifying data is imported.

ProofBench 1.1 Cost Efficiency
ProofBench 1.1 Cost Efficiency
Source-backed reasoning and nonreasoning configurations plotted against runtime effective cost. Each line is one canonical model. Color = provider.

How to read this chart

This chart compares source-backed ProofBench 1.1 configurations with runtime effective cost. Multiple reasoning levels for the same model are connected; models with one available level remain standalone points. Up and to the left is better.

Data sources
Artificial AnalysisARC PrizeVals Index v2 Cost per TestVals.aiProofBench 1.1
ProofBench 1.1 Scores
ProofBench 1.1 Scores
Native Lean 4.25.2 verification including native_decide. Version 1.1 only; not comparable to the unversioned historical cohort. Contributes to Mathematical Reasoning using a provisional calibrated scale.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
ProofBench 1.1
Data updated Sep 22, 2026
ProofBench 1.1 vs Effective Cost
ProofBench 1.1 vs Effective Cost
X = effective cost (log). Y = ProofBench 1.1. Native Lean 4.25.2 verification including native_decide. Version 1.1 only; not comparable to the unversioned historical cohort.
Controls:
ProofBench 1.11:1Cost

How to read this chart

Each point is a public model. The chart compares ProofBench 1.1 (%) against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

Data sources
Artificial AnalysisARC PrizeVals Index v2 Cost per TestVals.aiProofBench 1.1

← All benchmarks