Model Comparator

Compare up to four models using the same criteria.

2 models compared

✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.

Intelligence

Devstral Small 2
7.5
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
7.5

Coding

Devstral Small 2
29.3
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—

Math

Devstral Small 2
34.3
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Best: 63.7

Agentic

Devstral Small 2
2
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—

Speed

Devstral Small 2
142 t/s
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—

TTFT

Devstral Small 2
2.29 s
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—

Context window

Devstral Small 2
Best: 256K
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
128K

Reasoning

Devstral Small 2
No
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Yes

Open weights

Devstral Small 2
Yes
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Yes

Each reasoning level remains a separate configuration.

Score and cost

Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.

Intelligence Indexmost efficient ↗Intelligence Index cost
  • Devstral Small 27.5 · $0

Not plotted for lack of data on these axes: Llama 3.1 Nemotron Ultra 253B v1 (Reasoning).

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy