Back

Meta

Llama 3.1 Instruct 70B

Open weights
Intelligence
6.6
Rank 598 of 744 measured models
Output speed
36.7 t/s
Rank 376 of 403 measured models
Price/1M
$0.56
Rank 300 of 659 measured models
Context window
128K
Rank 773 of 1199 measured models

Llama 3.1 Instruct 70B scores 6.6 on the Artificial Analysis Intelligence Index, ranking 598th of 744 measured models. The closest models on this index are DeepSeek-V2.5 (6.6), Gemini 2.0 Flash Thinking Experimental (Dec '24) (6.6), and Granite 4.1 8B (6.6). At $0.56 per million tokens (3:1 input/output blended price), it is more expensive than Granite 4.1 8B ($0.063). With an output speed of 36.7 t/s, it is slower than Granite 4.1 8B (126 t/s).

Artificial Analysis Indices
Intelligence6.6
Rank 598 of 744 measured models
Math4.0
Rank 252 of 270 measured models
Standard Benchmarks
MMLU Pro67.6%
Rank 241 of 349 measured models
GPQA Diamond40.9%
Rank 523 of 619 measured models
HLE4.5%
Rank 521 of 664 measured models
LiveCodeBench23.2%
Rank 262 of 343 measured models
MATH-50064.9%
Rank 155 of 202 measured models
AIME 202417.3%
Rank 107 of 194 measured models
AIME 20254.0%
Rank 252 of 270 measured models
IFBench34.4%
Rank 336 of 450 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy