Model Comparator

Compare up to four models using the same criteria.

2 models compared

✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.

Intelligence

Llama Nemotron Super 49B v1.5 (Non-reasoning)
7.4
Devstral Small 2
Best: 7.5

Coding

Llama Nemotron Super 49B v1.5 (Non-reasoning)
—
Devstral Small 2
29.3

Math

Llama Nemotron Super 49B v1.5 (Non-reasoning)
8
Devstral Small 2
Best: 34.3

Agentic

Llama Nemotron Super 49B v1.5 (Non-reasoning)
—
Devstral Small 2
2

Speed

Llama Nemotron Super 49B v1.5 (Non-reasoning)
35.7 t/s
Devstral Small 2
Best: 142 t/s

TTFT

Llama Nemotron Super 49B v1.5 (Non-reasoning)
10.8 s
Devstral Small 2
Best: 2.29 s

Input · $ / 1M tokens

Llama Nemotron Super 49B v1.5 (Non-reasoning)
$0.40
Devstral Small 2
—

Output · $ / 1M tokens

Llama Nemotron Super 49B v1.5 (Non-reasoning)
$0.40
Devstral Small 2
—

Context window

Llama Nemotron Super 49B v1.5 (Non-reasoning)
128K
Devstral Small 2
Best: 256K

Reasoning

Llama Nemotron Super 49B v1.5 (Non-reasoning)
No
Devstral Small 2
No

Open weights

Llama Nemotron Super 49B v1.5 (Non-reasoning)
Yes
Devstral Small 2
Yes

Each reasoning level remains a separate configuration.

Score and cost

Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.

Intelligence Indexmost efficient ↗Output speed
  • Llama Nemotron Super 49B v1.5 (Non-reasoning)7.4 · 35.7 t/s
  • Devstral Small 27.5 · 142 t/s

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy