Back

Google

Gemini 1.5 Pro (May '24)

Closed weights
Intelligence
6.4
Rank 613 of 744 measured models
Coding
19.8
Rank 233 of 298 measured models
Context window
2M
Rank 8 of 1199 measured models

Gemini 1.5 Pro (May '24) scores 6.4 on the Artificial Analysis Intelligence Index, ranking 613th of 744 measured models. The closest models on this index are Llama 3.2 Instruct 90B (Vision) (6.4), Qwen2.5 Turbo (6.4), and R1 1776 (6.4).

Artificial Analysis Indices
Intelligence6.4
Rank 613 of 744 measured models
Coding19.8
Rank 233 of 298 measured models
Standard Benchmarks
MMLU Pro65.7%
Rank 251 of 349 measured models
GPQA Diamond37.1%
Rank 539 of 619 measured models
HLE3.5%
Rank 630 of 664 measured models
LiveCodeBench24.4%
Rank 256 of 343 measured models
MATH-50067.3%
Rank 152 of 202 measured models
AIME 20248.0%
Rank 142 of 194 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy