IQ vs Completion Time

Completion time is time to last token (TTLT): time to first answer token plus output tokens ÷ throughput (TPS). Drag the input slider (1K–10K tokens) and output slider (100–10K tokens) to see how TTLT changes with the workload.

IQ vs Completion Time
Completion time is time to last token (TTLT): time to first answer token plus output tokens ÷ throughput (TPS). Drag the input slider (1K–10K tokens) and output slider (100–10K tokens) to see how TTLT changes with the workload.
Controls:
Input10K tok
Output1K tok
IQ1:1Completion Time

How to read this chart

Completion time is time to last token (TTLT): time to first answer token plus output tokens ÷ throughput (TPS). Drag the input slider (1K–10K tokens) and output slider (100–10K tokens) to see how TTLT changes with the workload.