AI IQ
Subscribe

GDP.pdf Scores

Exact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.

GDP.pdf Scores
GDP.pdf Cost Efficiency
X-axis
Effective cost (est.)Completion time (est.)

This chart is part of the GDP.pdf benchmark page, which adds the model table, sources and how to read each view.

IQ DimensionsKnowledge Work IQ Bell CurveEach model's estimated Knowledge Work IQ, placed on a standard normal IQ distribution.Data: Artificial Analysis, Full source leaderboard reconciliation, Full source leaderboard reconciliationOpen chartCoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +26 moreOpen chartIQ BenchmarksGDPval-AA v2.1 normalized score ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAA-Briefcase v1.1 Elo ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAutomationBench-AA ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAA-AnalystAgent ScoresQuantitative analysis from spreadsheets and documents. Headline pass^5: correct on every one of five attempts, not pass@5. Contributes to Knowledge Work using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chart