Back

Meta

Llama 3.1 Instruct 8B

Open weights
Intelligence
6.9
Rank 578 of 744 measured models
Coding
5.4
Rank 284 of 298 measured models
Output speed
139 t/s
Rank 108 of 403 measured models
Price/1M
$0.043
Rank 46 of 659 measured models
Context window
128K
Rank 773 of 1199 measured models

Llama 3.1 Instruct 8B scores 6.9 on the Artificial Analysis Intelligence Index, ranking 578th of 744 measured models. The closest models on this index are Grok Beta (6.9), Llama 3.1 Nemotron Instruct 70B (6.9), and Meta: Llama 3.1 8B Instruct (6.9). At $0.043 per million tokens (3:1 input/output blended price), it is cheaper than Llama 3.1 Nemotron Instruct 70B ($1.20) and Meta: Llama 3.1 8B Instruct ($0.0575). With an output speed of 139 t/s, it is faster than Llama 3.1 Nemotron Instruct 70B (33.9 t/s).

Artificial Analysis Indices
Intelligence6.9
Rank 578 of 744 measured models
Coding5.4
Rank 284 of 298 measured models
Math4.3
Rank 250 of 270 measured models
Standard Benchmarks
MMLU Pro47.6%
Rank 305 of 349 measured models
GPQA Diamond25.9%
Rank 601 of 619 measured models
HLE5.3%
Rank 455 of 664 measured models
LiveCodeBench11.6%
Rank 306 of 343 measured models
MATH-50051.9%
Rank 172 of 202 measured models
AIME 20247.7%
Rank 145 of 194 measured models
AIME 20254.3%
Rank 250 of 270 measured models
IFBench28.6%
Rank 394 of 450 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy