Back

DeepSeek

DeepSeek V3 (Dec '24)

Open weightsModels.devHugging Face
Intelligence
8.5
Rank 488 of 744 measured models
Coding
23.0
Rank 211 of 298 measured models
Output speed
37 t/s
Rank 374 of 403 measured models
Price/1M
$0.463
Rank 268 of 659 measured models
Context window
128K
Rank 773 of 1199 measured models
Cost per task
$0.0198
Rank 23 of 193 measured models

DeepSeek V3 (Dec '24) scores 8.5 on the Artificial Analysis Intelligence Index, ranking 488th of 744 measured models. The closest models on this index are Devstral 2 (8.6), DeepSeek R1 Distill Qwen 32B (8.4), and GLM-4.6V (8.4). At $0.463 per million tokens (3:1 input/output blended price), it is priced close to GLM-4.6V ($0.45). With an output speed of 37 t/s, it is slower than Devstral 2 (139 t/s) and GLM-4.6V (82.1 t/s).

Artificial Analysis Indices
Intelligence8.5
Rank 488 of 744 measured models
Coding23.0
Rank 211 of 298 measured models
Math26.0
Rank 196 of 270 measured models
Agentic0.8
Rank 174 of 189 measured models
Capability indexes
Performance in specific industries, measured by Artificial Analysis
Finance & Accounting8.6
Rank 196 of 218 measured models
Strategy & Ops7.4
Rank 182 of 218 measured models
Legal10.2
Rank 194 of 218 measured models
Engineering10.5
Rank 203 of 217 measured models
Economics12.3
Rank 208 of 225 measured models
Standard Benchmarks
MMLU Pro75.2%
Rank 175 of 349 measured models
GPQA Diamond55.7%
Rank 438 of 619 measured models
HLE2.9%
Rank 650 of 664 measured models
LiveCodeBench35.9%
Rank 194 of 343 measured models
SciCode35.8%
Rank 199 of 231 measured models
MATH-50088.7%
Rank 80 of 202 measured models
AIME 202425.3%
Rank 92 of 194 measured models
AIME 202526.0%
Rank 196 of 270 measured models
Models at a similar level
The closest models on the Intelligence Index, one configuration per family.

Preferences and analytics

Rybbit: visits, performance, clicks, copies, forms and session replay (masked inputs), with your permission. Refusing does not limit the site.

Privacy

Allow navigation analytics?

With your permission, Rybbit measures visits, performance and interactions (clicks, copies, forms), including session replay, to improve BenchSift. Input values are masked in replays. Refusing does not limit the site.

Your choice is stored for 180 days. Change it at any time using “Privacy preferences” in the footer. Withdrawal reloads the page.

No choice stored: Rybbit is disabled.

Privacy