Back

OpenAI

GPT-4o (Aug '24)

Closed weightsModels.dev
Intelligence
7.7
Rank 520 of 744 measured models
Output speed
147 t/s
Rank 92 of 403 measured models
Price/1M
$4.38
Rank 557 of 659 measured models
Context window
128K
Rank 773 of 1199 measured models

GPT-4o (Aug '24) scores 7.7 on the Artificial Analysis Intelligence Index, ranking 520th of 744 measured models. The closest models on this index are Llama 3.3 Instruct 70B (7.7), Qwen2.5 72B Instruct (7.7), and Qwen2.5 Instruct 72B (7.7). At $4.38 per million tokens (3:1 input/output blended price), it is more expensive than Llama 3.3 Instruct 70B ($0.712), Qwen2.5 72B Instruct ($0.37), and Qwen2.5 Instruct 72B ($0.48). With an output speed of 147 t/s, it is faster than Llama 3.3 Instruct 70B (92.7 t/s) and Qwen2.5 Instruct 72B (30.9 t/s).

Artificial Analysis Indices
Intelligence7.7
Rank 520 of 744 measured models
Standard Benchmarks
GPQA Diamond52.1%
Rank 457 of 619 measured models
HLE2.3%
Rank 661 of 664 measured models
LiveCodeBench31.7%
Rank 213 of 343 measured models
MATH-50079.5%
Rank 110 of 202 measured models
AIME 202411.7%
Rank 122 of 194 measured models
IFBench36.0%
Rank 326 of 450 measured models
AA-LCR41.0%
Rank 367 of 575 measured models
TerminalBench Hard8.3%
Rank 249 of 432 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy