Model Comparator
Compare up to four models using the same criteria.
2 models compared
- Claude 3.5 Sonnet (June '24)
Anthropic
- Llama 3.1 Tulu3 405B
Allen Institute for AI
✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.
| Metrics | Claude 3.5 Sonnet (June '24) Anthropic | Llama 3.1 Tulu3 405B Allen Institute for AI | Add a model · 2/4 |
|---|---|---|---|
| Intelligence | 7.2 | 7.2 | |
| Coding | 26 | — | |
| Input · $ / 1M tokens | $3 | — | |
| Output · $ / 1M tokens | $15 | — | |
| Context window | Best: 200K | 128K | |
| Reasoning | No | No | |
| Open weights | No | Yes |
Intelligence
- Claude 3.5 Sonnet (June '24)
- 7.2
- Llama 3.1 Tulu3 405B
- 7.2
Coding
- Claude 3.5 Sonnet (June '24)
- 26
- Llama 3.1 Tulu3 405B
- —
Input · $ / 1M tokens
- Claude 3.5 Sonnet (June '24)
- $3
- Llama 3.1 Tulu3 405B
- —
Output · $ / 1M tokens
- Claude 3.5 Sonnet (June '24)
- $15
- Llama 3.1 Tulu3 405B
- —
Context window
- Claude 3.5 Sonnet (June '24)
- Best: 200K
- Llama 3.1 Tulu3 405B
- 128K
Reasoning
- Claude 3.5 Sonnet (June '24)
- No
- Llama 3.1 Tulu3 405B
- No
Open weights
- Claude 3.5 Sonnet (June '24)
- No
- Llama 3.1 Tulu3 405B
- Yes
Each reasoning level remains a separate configuration.
Score and cost
Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.
- Claude 3.5 Sonnet (June '24)7.2 · $6
Not plotted for lack of data on these axes: Llama 3.1 Tulu3 405B.