Model Comparator
Compare up to four models using the same criteria.
2 models compared
- GPT-4o mini
OpenAI
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
Nous Research
✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.
| Metrics | GPT-4o mini OpenAI | Hermes 4 - Llama-3.1 70B (Non-reasoning) Nous Research | Add a model · 2/4 |
|---|---|---|---|
| Intelligence | 6.7 | 6.7 | |
| Coding | 11.4 | — | |
| Math | Best: 14.7 | 11.3 | |
| Speed | 113 t/s | — | |
| TTFT | 0.86 s | — | |
| Input · $ / 1M tokens | $0.15 | — | |
| Output · $ / 1M tokens | $0.60 | — | |
| Context window | 128K | 128K | |
| Reasoning | No | No | |
| Open weights | No | Yes |
Intelligence
- GPT-4o mini
- 6.7
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- 6.7
Coding
- GPT-4o mini
- 11.4
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- —
Math
- GPT-4o mini
- Best: 14.7
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- 11.3
Speed
- GPT-4o mini
- 113 t/s
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- —
TTFT
- GPT-4o mini
- 0.86 s
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- —
Input · $ / 1M tokens
- GPT-4o mini
- $0.15
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- —
Output · $ / 1M tokens
- GPT-4o mini
- $0.60
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- —
Context window
- GPT-4o mini
- 128K
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- 128K
Reasoning
- GPT-4o mini
- No
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- No
Open weights
- GPT-4o mini
- No
- Hermes 4 - Llama-3.1 70B (Non-reasoning)
- Yes
Each reasoning level remains a separate configuration.
Score and cost
Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.
- GPT-4o mini6.7 · $0.262
Not plotted for lack of data on these axes: Hermes 4 - Llama-3.1 70B (Non-reasoning).