Back

Meta

Llama 3 Instruct 70B

Open weights
Intelligence
5.5
Rank 669 of 744 measured models
Price/1M
$1.18
Rank 403 of 659 measured models
Context window
8K
Rank 1135 of 1199 measured models

Llama 3 Instruct 70B scores 5.5 on the Artificial Analysis Intelligence Index, ranking 669th of 744 measured models. The closest models on this index are Claude 2.0 (5.5), DeepSeek R1 Distill Qwen 1.5B (5.5), and GPT-3.5 Turbo (5.5). At $1.18 per million tokens (3:1 input/output blended price), it is more expensive than GPT-3.5 Turbo ($0.75).

Artificial Analysis Indices
Intelligence5.5
Rank 669 of 744 measured models
Standard Benchmarks
MMLU Pro57.4%
Rank 279 of 349 measured models
GPQA Diamond37.9%
Rank 537 of 619 measured models
HLE4.5%
Rank 521 of 664 measured models
LiveCodeBench19.8%
Rank 270 of 343 measured models
MATH-50048.3%
Rank 177 of 202 measured models
AIME 20240.0%
Rank 181 of 194 measured models
IFBench37.1%
Rank 309 of 450 measured models
AA-LCR0.0%
Rank 513 of 575 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy