Model Comparator
Compare up to four models using the same criteria.
2 models compared
✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.
| Metrics | Add a model · 2/4 | ||
|---|---|---|---|
| Intelligence | 3.8 | Best: 4.3 | |
| Coding | 5.8 | Best: 26.6 | |
| Math | 18.3 | — | |
| Agentic | 0.1 | Best: 0.8 | |
| Speed | 52.6 t/s | Best: 143 t/s | |
| TTFT | 2.94 s | Best: 1.54 s | |
| Input · $ / 1M tokens | — | $0.15 | |
| Output · $ / 1M tokens | — | $0.60 | |
| Context window | 128K | Best: 256K | |
| Reasoning | No | Yes | |
| Open weights | Yes | Yes | |
| Cost / task | Best: $0 | $0.0399 |
Intelligence
- Gemma 3 12B Instruct
- 3.8
- Mistral Small 4 (Reasoning)
- Best: 4.3
Coding
- Gemma 3 12B Instruct
- 5.8
- Mistral Small 4 (Reasoning)
- Best: 26.6
Math
- Gemma 3 12B Instruct
- 18.3
- Mistral Small 4 (Reasoning)
- —
Agentic
- Gemma 3 12B Instruct
- 0.1
- Mistral Small 4 (Reasoning)
- Best: 0.8
Speed
- Gemma 3 12B Instruct
- 52.6 t/s
- Mistral Small 4 (Reasoning)
- Best: 143 t/s
TTFT
- Gemma 3 12B Instruct
- 2.94 s
- Mistral Small 4 (Reasoning)
- Best: 1.54 s
Input · $ / 1M tokens
- Gemma 3 12B Instruct
- —
- Mistral Small 4 (Reasoning)
- $0.15
Output · $ / 1M tokens
- Gemma 3 12B Instruct
- —
- Mistral Small 4 (Reasoning)
- $0.60
Context window
- Gemma 3 12B Instruct
- 128K
- Mistral Small 4 (Reasoning)
- Best: 256K
Reasoning
- Gemma 3 12B Instruct
- No
- Mistral Small 4 (Reasoning)
- Yes
Open weights
- Gemma 3 12B Instruct
- Yes
- Mistral Small 4 (Reasoning)
- Yes
Cost / task
- Gemma 3 12B Instruct
- Best: $0
- Mistral Small 4 (Reasoning)
- $0.0399
Each reasoning level remains a separate configuration.
Score and cost
Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.
- Gemma 3 12B Instruct3.8 · $0
- Mistral Small 4 (Reasoning)4.3 · $0.0399