Back

Nous Research

Hermes 4 - Llama-3.1 70B

ReasoningOpen weights
Intelligence
7.9
Rank 506 of 744 measured models
Context window
128K
Rank 773 of 1199 measured models

Hermes 4 - Llama-3.1 70B (Reasoning) scores 7.9 on the Artificial Analysis Intelligence Index, ranking 506th of 744 measured models. The closest models on this index are Claude 3.5 Sonnet (Oct '24) (7.9), DeepSeek R1 Distill Llama 70B (7.9), and Gemini 1.5 Pro (Sep '24) (7.9).

Artificial Analysis Indices
Reasoning
Intelligence7.9
Rank 506 of 744 measured models
Math68.7
Rank 99 of 270 measured models
Standard Benchmarks
MMLU Pro81.1%
Rank 94 of 349 measured models
GPQA Diamond69.9%
Rank 322 of 619 measured models
HLE8.8%
Rank 356 of 664 measured models
LiveCodeBench65.3%
Rank 95 of 343 measured models
AIME 202568.7%
Rank 99 of 270 measured models
IFBench31.3%
Rank 378 of 450 measured models
AA-LCR9.7%
Rank 489 of 575 measured models
TerminalBench Hard4.5%
Rank 299 of 432 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy