Model Comparator

Compare up to four models using the same criteria.

Gemini 2.0 Flash-Lite (Feb '25)
Google
Hermes 4 - Llama-3.1 405B (Non-reasoning)
Nous Research

Differences only

✓ Best published value among measured models. — Data unavailable. These metrics do not establish an overall ranking.

Model Comparator
Metrics	Gemini 2.0 Flash-Lite (Feb '25) Google	Hermes 4 - Llama-3.1 405B (Non-reasoning) Nous Research
Intelligence	7.4	7.4
Math	—	15.3
Speed	—	38.1 t/s
TTFT	—	2.34 s
Input · $ / 1M tokens	—	$1
Output · $ / 1M tokens	—	$3
Context window	Best: 1M	128K
Reasoning	No	No
Open weights	No	Yes

Intelligence

Gemini 2.0 Flash-Lite (Feb '25): 7.4
Hermes 4 - Llama-3.1 405B (Non-reasoning): 7.4

Math

Gemini 2.0 Flash-Lite (Feb '25): —
Hermes 4 - Llama-3.1 405B (Non-reasoning): 15.3

Speed

Gemini 2.0 Flash-Lite (Feb '25): —
Hermes 4 - Llama-3.1 405B (Non-reasoning): 38.1 t/s

TTFT

Gemini 2.0 Flash-Lite (Feb '25): —
Hermes 4 - Llama-3.1 405B (Non-reasoning): 2.34 s

Input · $ / 1M tokens

Gemini 2.0 Flash-Lite (Feb '25): —
Hermes 4 - Llama-3.1 405B (Non-reasoning): $1

Output · $ / 1M tokens

Gemini 2.0 Flash-Lite (Feb '25): —
Hermes 4 - Llama-3.1 405B (Non-reasoning): $3

Context window

Gemini 2.0 Flash-Lite (Feb '25): Best: 1M
Hermes 4 - Llama-3.1 405B (Non-reasoning): 128K

Reasoning

Gemini 2.0 Flash-Lite (Feb '25): No
Hermes 4 - Llama-3.1 405B (Non-reasoning): No

Open weights

Gemini 2.0 Flash-Lite (Feb '25): No
Hermes 4 - Llama-3.1 405B (Non-reasoning): Yes

Each reasoning level remains a separate configuration.

Score and cost

Each line joins the reasoning levels of a compared model; the large point marks the configuration in the table. The top-right corner holds the best score for the lowest cost. Select another point to compare that level.

Hermes 4 - Llama-3.1 405B (Non-reasoning)7.4 · $1.50

Not plotted for lack of data on these axes: Gemini 2.0 Flash-Lite (Feb '25).