NVIDIA

Llama 3.3 Nemotron Super 49B v1

Intelligence
7.3
Rank 575 of 782 measured models
Context window
128K
Rank 845 of 1325 measured models

Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) scores 7.3 on the Artificial Analysis Intelligence Index, ranking 575th of 782 measured models. The closest models on this index are Gemini 2.0 Flash-Lite (Preview) (7.3), GPT-4o (May '24) (7.3), and Kimi Linear 48B A3B Instruct (7.3).

Artificial Analysis Indices
Non-reasoning
Intelligence7.3
Rank 575 of 782 measured models
Math7.7
Rank 237 of 270 measured models
Standard Benchmarks
MMLU Pro69.8%
Rank 223 of 349 measured models
GPQA Diamond51.7%
Rank 460 of 621 measured models
HLE3.8%
Rank 611 of 682 measured models
LiveCodeBench28.0%
Rank 235 of 343 measured models
MATH-50077.5%
Rank 116 of 202 measured models
AIME 202419.3%
Rank 104 of 194 measured models
AIME 20257.7%
Rank 237 of 270 measured models
IFBench39.5%
Rank 284 of 451 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy