KernelBench Hard Benchmark Scores

Each model's audited KernelBench Hard pass rate. Color = provider.

KernelBench Hard Benchmark Scores
Each model's audited KernelBench Hard pass rate. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
KernelBench Hard vs Effective Cost
X = effective cost (log). Y = KernelBench Hard pass rate. Color = provider.
Controls:
KernelBench Hard1:1Cost

How to read this chart

Each point is a public model. The chart compares KernelBench Hard % against Effective Cost (per 1M I/O Tokens), with color showing the model provider.