OSWorld 2.0 Scores
Official OSWorld 2.0 leaderboard only: 108 long-horizon desktop tasks, 500-step budget, full task set, binary completion accuracy, best reasoning/tool configuration per model. Partial-credit scores and provider-reported launch figures are excluded. Contributes to Computer Use using a provisional calibrated scale.
OSWorld 2.0 Scores
OSWorld 2.0 Scores
Official OSWorld 2.0 leaderboard only: 108 long-horizon desktop tasks, 500-step budget, full task set, binary completion accuracy, best reasoning/tool configuration per model. Partial-credit scores and provider-reported launch figures are excluded. Contributes to Computer Use using a provisional calibrated scale.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
OSWorld 2.0 vs Effective Cost
OSWorld 2.0 vs Effective Cost
X = effective cost (log). Y = OSWorld 2.0. Official OSWorld 2.0 leaderboard only: 108 long-horizon desktop tasks, 500-step budget, full task set, binary completion accuracy, best reasoning/tool configuration per model. Partial-credit scores and provider-reported launch figures are excluded.
Controls:
How to read this chart
Each point is a public model. The chart compares OSWorld 2.0 (%) against Effective Cost (per 1M I/O Tokens), with color showing the model provider.
IQ DimensionsComputer Use IQEach model's Computer Use IQ plotted on a standard normal IQ distributionData: LLM Stats, LLM Stats BrowseComp, OSWorld +6 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI FrontierMath, ProofBench 1.1 +24 moreOpen chartIQ BenchmarksArena.ai Agent Arena ScoresAggregate net improvement across real-world Agent Mode sessions. Color = provider.Data: Arena.ai Agent ArenaOpen chartIQ BenchmarksBrowseComp Benchmark ScoresEach model's BrowseComp score. Color = provider.Data: LLM Stats, LLM Stats BrowseCompOpen chartIQ BenchmarksMCP Atlas Benchmark ScoresReal-world MCP tool-use pass rates. Color = provider.Data: Scale Labs, Scale Labs MCP AtlasOpen chartIQ BenchmarksAgents' Last Exam Benchmark ScoresFull / Overall pass rates from Agents' Last Exam. Color = provider.Data: Agents' Last ExamOpen chart