All comparisons
HellaSwag 95.8 95.7 HumanEval 89.0 85.5 Massive Multitask Language Understanding 88.6 88.5 Chatbot Arena 1228.0 1302.0 Google-Proof Q&A 51.5 — LiveCodeBench — 49.6 Aider Polyglot — 48.4 BigCodeBench — 50.0 MMLU PRO — 75.9
Llama 3.1 405B vs DeepSeek V3
Side-by-side comparison of specifications, capabilities, and pricing.
| Released | 2024-07-23 | 2024-12-26 |
| Context window | 128K | 64k |
| Parameters | 405B | 671B |
| Architecture | decoder only | mixture of experts |
| License | Open Source | Open Source |
| Knowledge cutoff | — | 2024-04 |
Capabilities | ||
| Vision | ||
| Multimodal | ||
| Reasoning | ||
| Function calling | ||
| Tool use | ||
| Structured Outputs | ||
| Code execution | ||
Availability | ||
| Providers | — | |
Benchmarks