Back

Nous Research

Hermes 4 - Llama-3.1 405B

Open weights
Intelligence
7.4
Rank 543 of 744 measured models
Output speed
38.1 t/s
Rank 369 of 403 measured models
Price/1M
$1.50
Rank 426 of 659 measured models
Context window
128K
Rank 773 of 1199 measured models

Hermes 4 - Llama-3.1 405B (Non-reasoning) scores 7.4 on the Artificial Analysis Intelligence Index, ranking 543rd of 744 measured models. The closest models on this index are Gemini 2.0 Flash-Lite (Feb '25) (7.4), Granite 4.1 30B (7.4), and Llama Nemotron Super 49B v1.5 (7.4). At $1.50 per million tokens (3:1 input/output blended price), it is more expensive than Llama Nemotron Super 49B v1.5 ($0.40). With an output speed of 38.1 t/s, it is faster than Llama Nemotron Super 49B v1.5 (35.7 t/s).

Artificial Analysis Indices
Non-reasoning
Intelligence7.4
Rank 543 of 744 measured models
Math15.3
Rank 218 of 270 measured models
Reasoning levels
Each point is a reasoning level of this model: more reasoning often raises the score but costs more. Select a point to open that level.
Intelligence Indexmost efficient ↗Price / 1M tokens
Standard Benchmarks
MMLU Pro72.9%
Rank 201 of 349 measured models
GPQA Diamond53.6%
Rank 449 of 619 measured models
HLE4.2%
Rank 553 of 664 measured models
LiveCodeBench54.6%
Rank 132 of 343 measured models
AIME 202515.3%
Rank 218 of 270 measured models
IFBench34.8%
Rank 331 of 450 measured models
AA-LCR22.0%
Rank 439 of 575 measured models
TerminalBench Hard9.8%
Rank 242 of 432 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy