Knowledge Work IQ Over Time
Each model's estimated Knowledge Work IQ by release date. Step-lines connect each provider's flagship models over time.
Knowledge Work IQ Over Time
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +27 moreOpen chartIQ BenchmarksGDPval-AA v2.1 normalized score ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAA-Briefcase v1.1 Elo ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAutomationBench-AA ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksGDP.pdf ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAA-AnalystAgent ScoresQuantitative analysis from spreadsheets and documents. Headline pass^5: correct on every one of five attempts, not pass@5. Contributes to Knowledge Work using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chart