o1
Its best results are in Reliability (#108 of 177) and Programmatic Reasoning (#120 of 177); weakest in Computer Use (#144 of 176). Knowledge Work is estimated, because no results are published yet.
IQ profile
IQ dimensions
Ranks are among models scored in each dimension. Ranges are model-based estimates, not calibrated confidence intervals.
Benchmark results
16 of 39 Composite IQ benchmarks have a published result for o1. Benchmarks without a result stay listed so gaps are visible.
Abstract Reasoning IQ 79 · measuredBest: #60 of 76 on Chess Puzzles2/5
Epoch AI vEpoch 100-position leaderboard (task implementation versions recorded per run) · Oct 14
ARC Prize verified leaderboard · Sep 22
Mathematical Reasoning IQ 102 · measuredBest: #29 of 64 on MathArena3/5
Full source leaderboard reconciliation · Oct 23
Academic Reasoning IQ 106 · measuredBest: #24 of 45 on MMLU-Pro5/6
TIGER-Lab MMLU-Pro leaderboard (missing rows only) · Sep 22
Artificial Analysis v4.3.2 · Oct 27
Artificial Analysis v4.3.2 · Oct 27
Artificial Analysis model leaderboard · Sep 10
Artificial Analysis v4.3.2 · Oct 27
Programmatic Reasoning IQ 101 · measuredBest: #56 of 61 on LiveCodeBench1/6
Computer Use IQ 80 · measuredBest: #42 of 43 on BrowseComp1/5
LLM Stats BrowseComp · Sep 22
Reliability IQ 110 · measuredBest: #45 of 96 on IFBench4/6
Artificial Analysis v4.3.2 · Oct 27
Full source leaderboard reconciliation · Oct 23
Artificial Analysis v4.3.2 · Oct 27
Artificial Analysis v4.3.2 · Oct 27
Knowledge Work IQ 90 · estimatedNo published results0/6
Release & availability
Release details on record for this model.
- Released
- Developer
- OpenAI
- Weights
- ProprietaryHosted access only
- API price
- $15 in · $60 outper 1M tokens · full pricing
About this score
How much of o1's IQ is measured, and how the rest is estimated.
Every score in the benchmark tables comes from its source unchanged. Composite IQ averages all seven dimensions equally.
Knowledge Work has no published results yet, so its IQ is estimated from o1's other dimensions. Missing benchmarks can also draw on its predecessor, GPT 4o; a predecessor is an estimation input, not evidence that this model has the predecessor's measured results.
Benchmark versions and evaluation harnesses can differ between sources, so small gaps between models may not be meaningful.
Compare o1
Side-by-side pages for the models it is most often weighed against.
Frequently asked questions
Quick answers about o1, drawn from the same data as the rest of this page.
How AI IQ scores models →Get this data from the API →- What is the IQ of o1?
- o1 has an estimated IQ of 95, which ranks #148 out of 176 public models on the AI IQ leaderboard. The score combines seven equally weighted reasoning dimensions using measured benchmark results and conservative estimates for missing coverage.
- What is o1 best at?
- Among the dimensions with published benchmark results, o1 ranks highest in Reliability (IQ 110, #108 of 177) and Programmatic Reasoning (IQ 101, #120 of 177). Its lowest-ranked measured dimension is Computer Use (IQ 80, #144 of 176).
- What is the EQ of o1?
- o1 doesn't have an EQ score yet. EQ (emotional reasoning) is calculated from EQ-Bench 4 and AttuneBench, and neither has published a result for o1. AI IQ doesn't estimate EQ from other benchmarks, so the score appears once one of those results is published.
- Which benchmarks has o1 been tested on?
- o1 has published results on 16 of the 39 benchmarks behind AI IQ's Composite IQ, including MathArena, IFBench, MMLU-Pro, SimpleQA Verified and AA Omniscience.
- How much does o1 cost?
- o1 costs $15.00 per million input tokens and $60.00 per million output tokens. Adjusted for how many tokens it actually consumes on real tasks, its effective cost works out to $74.68 per million input-plus-output tokens.
- Is o1 open source?
- No — o1 is a proprietary model. Its weights are not publicly available, so it is used through hosted APIs and products.
- Who developed o1?
- o1 was developed by OpenAI, based in the United States.
- When was o1 released?
- o1 was publicly released on December 5, 2024.
- How large is the context window of o1?
- AI IQ hasn't verified an input context limit for o1 from its developer's documentation, so none is listed rather than guessing.
- How fast is o1?
- AI IQ doesn't have independent speed measurements for o1 yet. Speed comes from independent tests of a model's hosted API, which aren't available for every model — especially new, restricted-access, or self-hosted ones.