Back

Allen Institute for AI

OLMo 2 7B

Open weights
Intelligence
5.6
Rank 663 of 744 measured models
Context window
4K
Rank 1167 of 1199 measured models

OLMo 2 7B scores 5.6 on the Artificial Analysis Intelligence Index, ranking 663rd of 744 measured models. The closest models on this index are Claude 2.1 (5.6), Molmo 7B-D (5.6), and Reka Flash 3 (5.6).

Artificial Analysis Indices
Intelligence5.6
Rank 663 of 744 measured models
Math0.7
Rank 264 of 270 measured models
Standard Benchmarks
MMLU Pro28.2%
Rank 338 of 349 measured models
GPQA Diamond28.8%
Rank 589 of 619 measured models
HLE5.4%
Rank 451 of 664 measured models
LiveCodeBench4.1%
Rank 335 of 343 measured models
AIME 20250.7%
Rank 264 of 270 measured models
IFBench24.4%
Rank 420 of 450 measured models
AA-LCR0.0%
Rank 513 of 575 measured models
TerminalBench Hard0.0%
Rank 385 of 432 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy