Model Comparator
Compare up to four models using the same criteria.
2 models compared
- GPT-4o (Aug '24)
OpenAI
- Qwen2.5 Instruct 72B
Alibaba
✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.
| Metrics | GPT-4o (Aug '24) OpenAI | Qwen2.5 Instruct 72B Alibaba | Add a model · 2/4 |
|---|---|---|---|
| Intelligence | 7.7 | 7.7 | |
| Math | — | 14 | |
| Speed | Best: 147 t/s | 30.9 t/s | |
| TTFT | Best: 0.92 s | 3.92 s | |
| Input · $ / 1M tokens | $2.50×5.3 relative to the lowest price among the compared models | Best: $0.475 | |
| Output · $ / 1M tokens | $10×20.2 relative to the lowest price among the compared models | Best: $0.495 | |
| Context window | 128K | Best: 131K | |
| Reasoning | No | No | |
| Open weights | No | Yes |
Intelligence
- GPT-4o (Aug '24)
- 7.7
- Qwen2.5 Instruct 72B
- 7.7
Math
- GPT-4o (Aug '24)
- —
- Qwen2.5 Instruct 72B
- 14
Speed
- GPT-4o (Aug '24)
- Best: 147 t/s
- Qwen2.5 Instruct 72B
- 30.9 t/s
TTFT
- GPT-4o (Aug '24)
- Best: 0.92 s
- Qwen2.5 Instruct 72B
- 3.92 s
Input · $ / 1M tokens
- GPT-4o (Aug '24)
- $2.50×5.3 relative to the lowest price among the compared models
- Qwen2.5 Instruct 72B
- Best: $0.475
Output · $ / 1M tokens
- GPT-4o (Aug '24)
- $10×20.2 relative to the lowest price among the compared models
- Qwen2.5 Instruct 72B
- Best: $0.495
Context window
- GPT-4o (Aug '24)
- 128K
- Qwen2.5 Instruct 72B
- Best: 131K
Reasoning
- GPT-4o (Aug '24)
- No
- Qwen2.5 Instruct 72B
- No
Open weights
- GPT-4o (Aug '24)
- No
- Qwen2.5 Instruct 72B
- Yes
Each reasoning level remains a separate configuration.
Score and cost
Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.
- GPT-4o (Aug '24)7.7 · $4.38
- Qwen2.5 Instruct 72B7.7 · $0.48