SciCode

A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.

About SciCode

SciCode has source-backed multi-effort configurations. The Cost Efficiency chart expands only those configurations; the score bar remains one canonical row per model.

SciCode Cost Efficiency
Source-matched reasoning-effort score and task-cost configurations. Each line is one canonical model. Color = provider.

How to read this chart

Each line uses the shared model-configuration dataset to compare source-matched reasoning-effort levels on SciCode. Every point shows the score and AA cost per task for that exact configuration. Canonical score bars and bell curves remain one point per model.

SciCode Benchmark Scores
Each model's SciCode score. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

SciCode vs Effective Cost
X = effective cost (log). Y = SciCode %. Color = provider.
Controls:
SciCode1:1Cost

How to read this chart

Each point is a public model. The chart compares SciCode % against Effective Cost (per 1M I/O Tokens), with color showing the model provider.