IQ vs Latency (Time to First Token)

Each model's estimated IQ plotted against its time to first token (TTFT). Drag the input-length slider from 1K to 10K tokens — dots glide between AA's two measured anchors (values in between are linearly interpolated).

IQ vs Latency (Time to First Token)
Each model's estimated IQ plotted against its time to first token (TTFT). Drag the input-length slider from 1K to 10K tokens — dots glide between AA's two measured anchors (values in between are linearly interpolated).
Controls:
Input10K tok
IQ1:1Speed

How to read this chart

Each model's estimated IQ plotted against its time to first token (TTFT). Drag the input-length slider from 1K to 10K tokens — dots glide between AA's two measured anchors (values in between are linearly interpolated).