Knowledge Work IQ vs Speed
Each model's estimated Knowledge Work IQ against its completion time, which is time to last token (TTLT). Drag the input and output sliders to see how it changes with the workload.
Knowledge Work IQ vs Speed
CoreIQ Bell CurveEach model's estimated IQ, placed on a standard normal IQ distribution.Data: ARC Prize, Full source leaderboard reconciliation, Full source leaderboard reconciliation +27 moreOpen chartIQ BenchmarksGDPval-AA v2.1 normalized score ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAA-Briefcase v1.1 Elo ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAutomationBench-AA ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksGDP.pdf ScoresExact AA v4.3.2 model/configuration; never substitute older benchmark versions. Contributes to Knowledge Work using a provisional calibrated scale.Data: Artificial AnalysisOpen chartIQ BenchmarksAA-AnalystAgent ScoresQuantitative analysis from spreadsheets and documents. Headline pass^5: correct on every one of five attempts, not pass@5. Contributes to Knowledge Work using a provisional calibrated scale.Data: Full source leaderboard reconciliationOpen chart