Google

Gemma 3 12B Instruct

Intelligence
3.8
Rank 778 of 782 measured models
Coding
5.8
Rank 286 of 301 measured models
Output speed
52.6 t/s
Rank 364 of 449 measured models
Context window
128K
Rank 845 of 1325 measured models
Cost per task
$0
Rank 1 of 229 measured models

Gemma 3 12B Instruct scores 3.8 on the Artificial Analysis Intelligence Index, ranking 778th of 782 measured models. The closest models on this index are Mistral Small 4 (4.3), gpt-oss-120b (3.8), and North Mini Code (3.4). With an output speed of 52.6 t/s, it is slower than Mistral Small 4 (143 t/s), gpt-oss-120b (163 t/s), and North Mini Code (190 t/s).

Artificial Analysis Indices
Intelligence3.8
Rank 778 of 782 measured models
Coding5.8
Rank 286 of 301 measured models
Math18.3
Rank 214 of 270 measured models
Agentic0.1
Rank 190 of 191 measured models
Capability indexes
Performance in specific industries, measured by Artificial Analysis
Finance & Accounting3.8
Rank 253 of 254 measured models
Strategy & Ops2.9
Rank 252 of 254 measured models
Legal3.8
Rank 254 of 254 measured models
Engineering4.8
Rank 253 of 253 measured models
Economics5.3
Rank 260 of 261 measured models
Standard Benchmarks
MMLU Pro59.5%
Rank 269 of 349 measured models
GPQA Diamond34.9%
Rank 549 of 621 measured models
HLE4.2%
Rank 571 of 682 measured models
LiveCodeBench13.7%
Rank 297 of 343 measured models
SciCode16.4%
Rank 245 of 249 measured models
MATH-50085.3%
Rank 93 of 202 measured models
AIME 202422.0%
Rank 100 of 194 measured models
AIME 202518.3%
Rank 214 of 270 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy