Sarvam

Sarvam M (Reasoning, Based on Mistral Small 3.1)

Intelligence
5.3
Rank 717 of 781 measured models
Context window
32.8K
Rank 1094 of 1323 measured models

Sarvam M (Reasoning, Based on Mistral Small 3.1) scores 5.3 on the Artificial Analysis Intelligence Index, ranking 717th of 781 measured models. The closest models on this index are Command-R+ (Apr '24) (5.3), DBRX Instruct (5.3), and DeepSeek Coder V2 Lite Instruct (5.3).

Artificial Analysis Indices
Intelligence5.3
Rank 717 of 781 measured models
Standard Benchmarks
MMLU Pro69.6%
Rank 226 of 349 measured models
GPQA Diamond41.6%
Rank 519 of 620 measured models
HLE3.1%
Rank 663 of 681 measured models
LiveCodeBench29.5%
Rank 223 of 343 measured models
MATH-50084.7%
Rank 97 of 202 measured models
AIME 202420.3%
Rank 103 of 194 measured models
IFBench31.8%
Rank 370 of 451 measured models
AA-LCR0.0%
Rank 530 of 592 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy