AI IQ
Subscribe

OSWorld-Verified Benchmark Scores

Each model's OSWorld-Verified score. Color = provider.

OSWorld-Verified Benchmark Scores
OSWorld-Verified Benchmark Scores
Each model's OSWorld-Verified score. Color = provider.
Controls:

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
LLM StatsOSWorldanthropic-system-card
OSWorld-Verified vs Effective Cost
OSWorld-Verified vs Effective Cost
X = effective cost (log). Y = OSWorld-Verified %. Color = provider.
Controls:
OSWorld1:1Cost

How to read this chart

Each point is a public model. The chart compares OSWorld-Verified % against Effective Cost (per 1M I/O Tokens), with color showing the model provider.

Data sources
Artificial AnalysisARC PrizeVals.aiLLM StatsOSWorldanthropic-system-card
IQ DimensionsComputer Use IQEach model's Computer Use IQ plotted on a standard normal IQ distributionData: Artificial Analysis Terminal-Bench v2.1, Vals.ai Terminal-Bench 2.1, Artificial Analysis +6 moreOpen chartCoreAI Models on the IQ Bell CurveEach model's estimated IQ plotted on a standard normal IQ distributionData: ARC Prize, Epoch AI FrontierMath, Vals.ai +25 moreOpen chartIQ BenchmarksTerminal-Bench Hard Benchmark ScoresEach model's Terminal-Bench Hard score. Color = provider.Data: Artificial AnalysisOpen chartIQ BenchmarksTerminal-Bench 2.1 Benchmark ScoresEach model's Terminal-Bench 2.1 pass@1 score, using Artificial Analysis as canonical and Vals.ai as fallback. Color = provider.Data: Artificial Analysis Terminal-Bench v2.1, Vals.ai Terminal-Bench 2.1Open chartIQ BenchmarksBrowseComp Benchmark ScoresEach model's BrowseComp score. Color = provider.Data: LLM StatsOpen chartIQ BenchmarksMCP Atlas Benchmark ScoresReal-world MCP tool-use pass rates. Color = provider.Data: Scale Labs, anthropic-system-cardOpen chart