All comparisons
HellaSwag 95.8 — HumanEval 89.0 96.7 Massive Multitask Language Understanding 88.6 — Chatbot Arena 1228.0 1412.0 Google-Proof Q&A 51.5 87.7 SWE-bench Verified — 71.7 LiveCodeBench — 79.1 Aider Polyglot — 81.3 Massive Multi-discipline Multimodal Understanding — 82.9
Llama 3.1 405B vs o3
Side-by-side comparison of specifications, capabilities, and pricing.
| Released | 2024-07-23 | 2025-03-31 |
| Context window | 128K | 128K |
| Parameters | 405B | — |
| Architecture | decoder only | decoder only |
| License | Open Source | Unknown |
| Knowledge cutoff | — | — |
Capabilities | ||
| Vision | ||
| Multimodal | ||
| Reasoning | ||
| Function calling | ||
| Tool use | ||
| Structured Outputs | ||
| Code execution | ||
Availability | ||
| Providers | — | |
Benchmarks