Back

Meta

Llama 3.3 Instruct 70B

Open weights
Intelligence
7.7
Rank 520 of 744 measured models
Coding
11.9
Rank 261 of 298 measured models
Output speed
92.7 t/s
Rank 190 of 403 measured models
Price/1M
$0.712
Rank 331 of 659 measured models
Context window
128K
Rank 773 of 1199 measured models

Llama 3.3 Instruct 70B scores 7.7 on the Artificial Analysis Intelligence Index, ranking 520th of 744 measured models. The closest models on this index are GPT-4o (Aug '24) (7.7), Meta: Llama 3.3 70B Instruct (7.7), and Qwen2.5 72B Instruct (7.7). At $0.712 per million tokens (3:1 input/output blended price), it is cheaper than GPT-4o (Aug '24) ($4.38), more expensive than Meta: Llama 3.3 70B Instruct ($0.64) and Qwen2.5 72B Instruct ($0.37). With an output speed of 92.7 t/s, it is slower than GPT-4o (Aug '24) (147 t/s).

Artificial Analysis Indices
Intelligence7.7
Rank 520 of 744 measured models
Coding11.9
Rank 261 of 298 measured models
Math7.7
Rank 237 of 270 measured models
Standard Benchmarks
MMLU Pro71.3%
Rank 213 of 349 measured models
GPQA Diamond49.8%
Rank 474 of 619 measured models
HLE3.6%
Rank 618 of 664 measured models
LiveCodeBench28.8%
Rank 232 of 343 measured models
MATH-50077.3%
Rank 117 of 202 measured models
AIME 202430.0%
Rank 83 of 194 measured models
AIME 20257.7%
Rank 237 of 270 measured models
IFBench47.1%
Rank 202 of 450 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy