All comparisons
HellaSwag 95.7 95.8 HumanEval 85.5 89.0 Massive Multitask Language Understanding 88.5 88.6 LiveCodeBench 49.6 — Aider Polyglot 48.4 — BigCodeBench 50.0 — Chatbot Arena 1302.0 1228.0 MMLU PRO 75.9 — Google-Proof Q&A — 51.5
DeepSeek V3 vs Llama 3.1 405B
Side-by-side comparison of specifications, capabilities, and pricing.
| Released | 2024-12-26 | 2024-07-23 |
| Context window | 64k | 128K |
| Parameters | 671B | 405B |
| Architecture | mixture of experts | decoder only |
| License | Open Source | Open Source |
| Knowledge cutoff | 2024-04 | — |
Capabilities | ||
| Vision | ||
| Multimodal | ||
| Reasoning | ||
| Function calling | ||
| Tool use | ||
| Structured Outputs | ||
| Code execution | ||
Availability | ||
| Providers | — | |
Benchmarks