xAIReleased Aug 14, 2024
Proprietary
grok-2
Its best results are in Programmatic Reasoning (#146 of 177) and Mathematical Reasoning (#157 of 176); weakest in Academic Reasoning (#192 of 203). Four of seven dimensions are estimated, because no results are published yet.
Composite IQ ?
83
Effective cost
Not priced
No standard API rate
Speed
Not measured
No speed data yet
Context
Unverified
Not in publisher docs
Evidence
3of 7 dims
6 of 39 benchmarks
IQ profile
Seven dimensions, averaged equally into Composite IQ
MeasuredEstimated95% range
#1 in dimensionTop-10 median
IQ dimensions
Ranks are among models scored in each dimension. Ranges are model-based estimates, not calibrated confidence intervals.
DimensionIQPosition · 70–160RankEvidencevs Top 10
grok-295% range (model-based, uncalibrated)Top-10 median#1 in dimension100 = average human
Benchmark results
6 of 39 Composite IQ benchmarks have a published result for grok-2. Benchmarks without a result stay listed so gaps are visible.
Abstract Reasoning IQ 70 · estimatedNo published results0/5
No published results yet for Abstract Reasoning. The 70 shown is estimated from grok-2's other dimensions and will be replaced as results come in. How estimates work
ARC-AGI-3ARC-AGI-2ARC-AGI-1Chess PuzzlesMystery Game Puzzles
Mathematical Reasoning IQ 88 · measuredBest: #53 of 56 on AIME1/5
BenchmarkScorePercentileRankLeader · source
Not yet reported
FrontierMath Tier 4FrontierMath Tier 1-3ProofBench 1.1MathArena
Academic Reasoning IQ 100 · measuredBest: #38 of 45 on MMLU-Pro4/6
BenchmarkScorePercentileRankLeader · source
MMLU-Pro
TIGER-Lab MMLU-Pro leaderboard (missing rows only) · Sep 22
75.5%
#38 / 45
Leader fable-5.1 · 92.4%
TIGER-Lab MMLU-Pro leaderboard (missing rows only) · Sep 22
TIGER-Lab MMLU-Pro leaderboard (missing rows only) · Sep 22
SciCode
Artificial Analysis model leaderboard · Sep 10
28.5%
#157 / 167
Leader opus-5.5 · 66.9%
Artificial Analysis model leaderboard · Sep 10
Artificial Analysis model leaderboard · Sep 10
GPQA Diamond
Artificial Analysis model leaderboard · Sep 10
51.0%
#142 / 147
Leader gpt-6-astra · 96.1%
Artificial Analysis model leaderboard · Sep 10
Artificial Analysis model leaderboard · Sep 10
Humanity's Last Exam
Artificial Analysis model leaderboard · Sep 10
3.8%
#162 / 167
Leader opus-5.5 · 61.4%
Artificial Analysis model leaderboard · Sep 10
Artificial Analysis model leaderboard · Sep 10
Not yet reported
CritPtMMMU-Pro
Programmatic Reasoning IQ 98 · measuredBest: #61 of 61 on LiveCodeBench1/6
BenchmarkScorePercentileRankLeader · source
Not yet reported
IOI V2Terminal-Bench 4.0ProgramBenchSWE-rebenchMirrorCode
Computer Use IQ 70 · estimatedNo published results0/5
No published results yet for Computer Use. The 70 shown is estimated from grok-2's other dimensions and will be replaced as results come in. How estimates work
BrowseCompOSWorld-VerifiedMCP AtlasArena.ai Agent ArenaAgents' Last Exam
Reliability IQ 75 · estimatedNo published results0/6
No published results yet for Reliability. The 75 shown is estimated from grok-2's other dimensions and will be replaced as results come in. How estimates work
SimpleQA VerifiedaaOmniscienceBullshitBench v2IFBenchAA Long Context Reasoning v1.1FACTS Grounding
Knowledge Work IQ 79 · estimatedNo published results0/6
No published results yet for Knowledge Work. The 79 shown is estimated from grok-2's other dimensions and will be replaced as results come in. How estimates work
AA-Briefcase v1.1GDPval-AA v2.1AutomationBench-AAGDP.pdfAA-AnalystAgentEnterpriseOps-Gym-AA
Release & availability
Release details on record for this model.
- Released
- Developer
- xAI
- Weights
- ProprietaryHosted access only
About this score
How much of grok-2's IQ is measured, and how the rest is estimated.
6/ 39benchmark results
3/ 7dimensions measured
4estimated
0/5Abstract
1/5Math
4/6Academic
1/6Coding
0/5Computer Use
0/6Reliability
0/6Knowledge Work
Bar height = share of benchmarks with resultsEstimatedNo score
Measured results are shown as published
Every score in the benchmark tables comes from its source unchanged. Composite IQ averages all seven dimensions equally.
Estimates fill the gaps
Abstract Reasoning, Computer Use, Reliability and Knowledge Work have no published results yet, so their IQ is estimated from grok-2's other dimensions.
A missing result is not a zero
Benchmark versions and evaluation harnesses can differ between sources, so small gaps between models may not be meaningful.
Compare grok-2
Side-by-side pages for the models it is most often weighed against.
#1 overall
gpt-6.1-sol
IQ141 58 higherEffective cost$6.30
xAI #1
grok-4.7
IQ127 44 higherEffective cost$21.89
Closest IQ
LFM2.5 2.6B
IQ83 same IQ
Most similar profile
gemini-1.5-pro
IQ84 1 higher
#2 overall
opus-5.5
IQ141 58 higherEffective cost$35.73
#3 overall
Gemini 4 Argon
IQ140 57 higher
grok-2Comparison model
Frequently asked questions
Quick answers about grok-2, drawn from the same data as the rest of this page.
How AI IQ scores models →Get this data from the API →- What is the IQ of grok-2?
- grok-2 has an estimated IQ of 83, which ranks #171 out of 176 public models on the AI IQ leaderboard. The score combines seven equally weighted reasoning dimensions using measured benchmark results and conservative estimates for missing coverage.
- What is grok-2 best at?
- Among the dimensions with published benchmark results, grok-2 ranks highest in Programmatic Reasoning (IQ 98, #146 of 177) and Mathematical Reasoning (IQ 88, #157 of 176). Its lowest-ranked measured dimension is Academic Reasoning (IQ 100, #192 of 203).
- What is the EQ of grok-2?
- grok-2 doesn't have an EQ score yet. EQ (emotional reasoning) is calculated from EQ-Bench 4 and AttuneBench, and neither has published a result for grok-2. AI IQ doesn't estimate EQ from other benchmarks, so the score appears once one of those results is published.
- Which benchmarks has grok-2 been tested on?
- grok-2 has published results on 6 of the 39 benchmarks behind AI IQ's Composite IQ, including MMLU-Pro, SciCode, AIME, GPQA Diamond and Humanity's Last Exam.
- How much does grok-2 cost?
- AI IQ doesn't have a verified standard per-token API price for grok-2, so it can't calculate an effective cost. This is common for models offered only through subscriptions, restricted-access programs, or self-hosting.
- Is grok-2 open source?
- No — grok-2 is a proprietary model. Its weights are not publicly available, so it is used through hosted APIs and products.
- Who developed grok-2?
- grok-2 was developed by xAI, based in the United States.
- When was grok-2 released?
- grok-2 was publicly released on August 14, 2024.
- How large is the context window of grok-2?
- AI IQ hasn't verified an input context limit for grok-2 from its developer's documentation, so none is listed rather than guessing.
- How fast is grok-2?
- AI IQ doesn't have independent speed measurements for grok-2 yet. Speed comes from independent tests of a model's hosted API, which aren't available for every model — especially new, restricted-access, or self-hosted ones.