Allen Institute for AI

Olmo 3 7B Think

Intelligence
5.6
Rank 693 of 782 measured models
Context window
65.5K
Rank 1020 of 1325 measured models

Olmo 3 7B Think scores 5.6 on the Artificial Analysis Intelligence Index, ranking 693rd of 782 measured models. The closest models on this index are Claude 2.1 (5.6), Molmo 7B-D (5.6), and Claude 2.0 (5.5).

Artificial Analysis Indices
Intelligence5.6
Rank 693 of 782 measured models
Math70.7
Rank 95 of 270 measured models
Standard Benchmarks
MMLU Pro65.5%
Rank 253 of 349 measured models
GPQA Diamond51.6%
Rank 462 of 621 measured models
HLE6.0%
Rank 446 of 682 measured models
LiveCodeBench61.7%
Rank 111 of 343 measured models
AIME 202570.7%
Rank 95 of 270 measured models
IFBench41.5%
Rank 260 of 451 measured models
AA-LCR0.0%
Rank 531 of 593 measured models
TerminalBench Hard0.8%
Rank 370 of 432 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy