Terminal-Bench 2.1

A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.

About Terminal-Bench 2.1

Terminal-Bench 2.1 has source-backed multi-effort configurations. The Cost Efficiency chart expands only those configurations; the score bar remains one canonical row per model.

Terminal-Bench 2.1 Cost Efficiency
Source-matched reasoning-effort score and task-cost configurations. Each line is one canonical model. Color = provider.

How to read this chart

Each line uses the shared model-configuration dataset to compare source-matched reasoning-effort levels on Terminal-Bench 2.1. Every point shows the score and AA cost per task for that exact configuration. Canonical score bars and bell curves remain one point per model.

Terminal-Bench 2.1 Benchmark Scores
Each model's Terminal-Bench 2.1 pass@1 score, using Artificial Analysis as canonical and Vals.ai as fallback. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Terminal-Bench 2.1 vs Effective Cost
X = effective cost (log). Y = Terminal-Bench 2.1 %. Color = provider.
Controls:
Terminal-Bench1:1Cost

How to read this chart

Each point is a public model. The chart compares Terminal-Bench 2.1 % against Effective Cost (per 1M I/O Tokens), with color showing the model provider.