ModelRefs / Output Tokens/Sec Methodology and Evidence
Output Tokens/Sec Methodology and Evidence
Sustained streaming throughput once generation starts. Methodology, dataset provenance, and citation sources for Output Tokens/Sec.
Overview
Sustained streaming throughput once generation starts.
How it is measured: Mean output tok/s over a 1024-token generation.
How this benchmark is scored
| Category | latency |
|---|---|
| Maximum score | 500 tok/s |
| Direction | Higher is better |
Primary source: https://artificialanalysis.ai/
Published results
| Model | Score | Run date | Source |
|---|---|---|---|
| Llama 4 Scout | 175 | 2026-05-01 | Aggregated public reports |
| GPT-5 Mini | 142 | 2026-05-01 | Aggregated public reports |
| Gemini 3 Pro | 96 | 2026-05-01 | Aggregated public reports |
| Mistral Large 2 | 92 | 2026-05-01 | Aggregated public reports |
| GPT-5 | 84 | 2026-05-01 | Aggregated public reports |
| Claude Sonnet 4.5 | 78 | 2026-05-01 | Aggregated public reports |
Each score reflects the protocol and date of its own source run. Results from different harnesses are not directly comparable.
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Output Tokens/Sec Methodology and Evidence.
Frequently asked questions
What does the Output Tokens/Sec benchmark measure?
Sustained streaming throughput once generation starts.
What is the methodology?
Mean output tok/s over a 1024-token generation.