OSWorld-Verified Benchmark Scores
Each model's OSWorld-Verified score. Color = provider.
OSWorld-Verified Benchmark Scores
Each model's OSWorld-Verified score. Color = provider.
OSWorld-Verified Cost Efficiency
Source-backed OSWorld-Verified scores plotted against estimated effective cost per 1M I/O tokens (a runtime estimate, not a published task cost). Explicit reasoning/nonreasoning siblings are connected where both are public. Color = provider.
This chart is part of the OSWorld-Verified benchmark page, which adds the model table, sources and how to read each view.
IQ DimensionsComputer Use IQ Bell CurveEach model's estimated Computer Use IQ, placed on a standard normal IQ distribution.Data: LLM Stats, LLM Stats BrowseComp, OSWorld +5 moreOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Epoch AI, Epoch AI +26 moreOpen chartIQ BenchmarksArena.ai Agent Arena ScoresAggregate net improvement across real-world Agent Mode sessions. Color = provider.Data: Arena.ai Agent ArenaOpen chartIQ BenchmarksBrowseComp Benchmark ScoresEach model's BrowseComp score. Color = provider.Data: LLM Stats, LLM Stats BrowseCompOpen chartIQ BenchmarksMCP Atlas Benchmark ScoresReal-world MCP tool-use pass rates. Color = provider.Data: Scale Labs, Scale Labs MCP AtlasOpen chartIQ BenchmarksAgents' Last Exam Benchmark ScoresFull / Overall pass rates from Agents' Last Exam. Color = provider.Data: Agents' Last ExamOpen chart