OSWorld-Verified
A bird's-eye view of the benchmark: what it measures and every AI IQ chart built on it.
About OSWorld-Verified
OSWorld-Verified does not yet have two source-matched reasoning-effort score/cost rows for one model. The Cost Efficiency surface is reserved at the top of this page and will populate when qualifying data is imported.
How to read this chart
This chart compares source-backed OSWorld-Verified configurations with runtime effective cost. Multiple reasoning levels for the same model are connected; models with one available level remain standalone points. Up and to the left is better.
How to read this chart
Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.
How to read this chart
Each point is a public model. The chart compares OSWorld-Verified % against Effective Cost (per 1M I/O Tokens), with color showing the model provider.