Model Comparator

Compare up to four models using the same criteria.

2 models compared

✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.

Intelligence

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
7.5
Devstral Small 2
7.5

Coding

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—
Devstral Small 2
29.3

Math

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Best: 63.7
Devstral Small 2
34.3

Agentic

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—
Devstral Small 2
2

Speed

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—
Devstral Small 2
142 t/s

TTFT

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
—
Devstral Small 2
2.29 s

Context window

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
128K
Devstral Small 2
Best: 256K

Reasoning

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Yes
Devstral Small 2
No

Open weights

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Yes
Devstral Small 2
Yes

Each reasoning level remains a separate configuration.

Score and cost

Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.

Intelligence Indexmost efficient ↗Intelligence Index cost
  • Devstral Small 27.5 · $0

Not plotted for lack of data on these axes: Llama 3.1 Nemotron Ultra 253B v1 (Reasoning).

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy