Model Comparator
Compare up to four models using the same criteria.
2 models compared
- Gemini 1.5 Pro (Sep '24)
Google
- Claude 3.5 Sonnet (Oct '24)
Anthropic
✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.
| Metrics | Gemini 1.5 Pro (Sep '24) | Claude 3.5 Sonnet (Oct '24) Anthropic | Add a model · 2/4 |
|---|---|---|---|
| Intelligence | 7.9 | 7.9 | |
| Coding | 23.6 | Best: 30.2 | |
| Input · $ / 1M tokens | — | $3 | |
| Output · $ / 1M tokens | — | $15 | |
| Context window | Best: 2M | 200K | |
| Reasoning | No | No | |
| Open weights | No | No |
Intelligence
- Gemini 1.5 Pro (Sep '24)
- 7.9
- Claude 3.5 Sonnet (Oct '24)
- 7.9
Coding
- Gemini 1.5 Pro (Sep '24)
- 23.6
- Claude 3.5 Sonnet (Oct '24)
- Best: 30.2
Input · $ / 1M tokens
- Gemini 1.5 Pro (Sep '24)
- —
- Claude 3.5 Sonnet (Oct '24)
- $3
Output · $ / 1M tokens
- Gemini 1.5 Pro (Sep '24)
- —
- Claude 3.5 Sonnet (Oct '24)
- $15
Context window
- Gemini 1.5 Pro (Sep '24)
- Best: 2M
- Claude 3.5 Sonnet (Oct '24)
- 200K
Reasoning
- Gemini 1.5 Pro (Sep '24)
- No
- Claude 3.5 Sonnet (Oct '24)
- No
Open weights
- Gemini 1.5 Pro (Sep '24)
- No
- Claude 3.5 Sonnet (Oct '24)
- No
Each reasoning level remains a separate configuration.
Score and cost
Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.
- Claude 3.5 Sonnet (Oct '24)7.9 · $6
Not plotted for lack of data on these axes: Gemini 1.5 Pro (Sep '24).