Model Comparator
Compare up to four models using the same criteria.
2 models compared
- GPT-4o (Aug '24)
OpenAI
✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.
| Metrics | GPT-4o (Aug '24) OpenAI | Add a model · 2/4 | |
|---|---|---|---|
| Intelligence | 7.7 | 7.7 | |
| Coding | — | 11.9 | |
| Math | — | 7.7 | |
| Speed | Best: 147 t/s | 92.7 t/s | |
| TTFT | Best: 0.92 s | 1.71 s | |
| Input · $ / 1M tokens | $2.50×3.5 relative to the lowest price among the compared models | Best: $0.71 | |
| Output · $ / 1M tokens | $10×13.9 relative to the lowest price among the compared models | Best: $0.72 | |
| Context window | 128K | 128K | |
| Reasoning | No | No | |
| Open weights | No | Yes |
Intelligence
- GPT-4o (Aug '24)
- 7.7
- Llama 3.3 Instruct 70B
- 7.7
Coding
- GPT-4o (Aug '24)
- —
- Llama 3.3 Instruct 70B
- 11.9
Math
- GPT-4o (Aug '24)
- —
- Llama 3.3 Instruct 70B
- 7.7
Speed
- GPT-4o (Aug '24)
- Best: 147 t/s
- Llama 3.3 Instruct 70B
- 92.7 t/s
TTFT
- GPT-4o (Aug '24)
- Best: 0.92 s
- Llama 3.3 Instruct 70B
- 1.71 s
Input · $ / 1M tokens
- GPT-4o (Aug '24)
- $2.50×3.5 relative to the lowest price among the compared models
- Llama 3.3 Instruct 70B
- Best: $0.71
Output · $ / 1M tokens
- GPT-4o (Aug '24)
- $10×13.9 relative to the lowest price among the compared models
- Llama 3.3 Instruct 70B
- Best: $0.72
Context window
- GPT-4o (Aug '24)
- 128K
- Llama 3.3 Instruct 70B
- 128K
Reasoning
- GPT-4o (Aug '24)
- No
- Llama 3.3 Instruct 70B
- No
Open weights
- GPT-4o (Aug '24)
- No
- Llama 3.3 Instruct 70B
- Yes
Each reasoning level remains a separate configuration.
Score and cost
Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.
- GPT-4o (Aug '24)7.7 · $4.38
- Llama 3.3 Instruct 70B7.7 · $0.712