AI IQ
Consultation Subscribe

Toolathlon

A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.

About Toolathlon

Toolathlon does not yet have two source-matched reasoning-effort score/cost rows for one model. The Cost Efficiency surface is reserved at the top of this page and will populate when qualifying data is imported.

Toolathlon Cost Efficiency
Toolathlon Cost Efficiency
Source-backed reasoning and nonreasoning configurations plotted against runtime effective cost. Each line is one canonical model. Color = provider.

How to read this chart

This chart compares source-backed Toolathlon configurations with runtime effective cost. Multiple reasoning levels for the same model are connected; models with one available level remain standalone points. Up and to the left is better.

Data sources
Artificial AnalysisARC PrizeVals.aiLLM StatsToolathlonLLM Stats Toolathlon
Toolathlon Benchmark Scores
Toolathlon Benchmark Scores
Each model's Toolathlon score. Color = provider.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
LLM StatsToolathlonLLM Stats Toolathlon
Toolathlon vs Effective Cost
Toolathlon vs Effective Cost
X = effective cost (log). Y = Toolathlon %. Color = provider.
Controls:
Toolathlon1:1Cost

How to read this chart

Each point is a public model. The chart compares Toolathlon % against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

Data sources
Artificial AnalysisARC PrizeVals.aiLLM StatsToolathlonLLM Stats Toolathlon

← All benchmarks