KernelBench Mega Benchmark Scores
Each model's RTX PRO 6000 KernelBench Mega speedup over optimized PyTorch. Color = provider.
KernelBench Mega Benchmark Scores
KernelBench Mega Benchmark Scores
Each model's RTX PRO 6000 KernelBench Mega speedup over optimized PyTorch. Color = provider.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
KernelBench Mega vs Effective Cost
KernelBench Mega vs Effective Cost
X = effective cost (log). Y = KernelBench Mega speedup over optimized PyTorch. Color = provider.
Controls:
How to read this chart
Each point is a public model. The chart compares KernelBench Mega speedup against Effective Cost (per 1M I/O Tokens), with color showing the model provider.
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +21 moreOpen chartIQ BenchmarksARC-AGI-3 Benchmark ScoresEach model's ARC-AGI-3 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-2 ScoresEach model's ARC-AGI-2 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksARC-AGI-1 Benchmark ScoresEach model's ARC-AGI-1 score. Color = provider.Data: ARC PrizeOpen chartIQ BenchmarksFrontierMath Tier 4 Benchmark ScoresEach model's FrontierMath Tier 4 score. Color = provider.Data: Epoch AI FrontierMathOpen chartIQ BenchmarksFrontierMath Tier 1-3 Benchmark ScoresEach model's FrontierMath Tier 1-3 score. Color = provider.Data: Epoch AI FrontierMathOpen chart