All comparisons
Google-Proof Q&A 52.3 51.5 HellaSwag 90.2 95.8 HumanEval 78.4 89.0 Massive Multitask Language Understanding 78.9 88.6 Instruction-Following Evaluation 38.5 — Chatbot Arena — 1228.0
Mistral 7B Instruct v0.3 vs Llama 3.1 405B
Side-by-side comparison of specifications, capabilities, and pricing.
| Released | 2024-05-23 | 2024-07-23 |
| Context window | 32K | 128K |
| Parameters | 7B | 405B |
| Architecture | decoder only | decoder only |
| License | Apache 2.0 | Open Source |
| Knowledge cutoff | 2023-12 | — |
Capabilities | ||
| Vision | ||
| Multimodal | ||
| Reasoning | ||
| Function calling | ||
| Tool use | ||
| Structured Outputs | ||
| Code execution | ||
Availability | ||
| Providers | — | |
Benchmarks