LLM ReferenceLLM Reference
All comparisons

Mixtral 8x7B vs Llama 3.1 405B

Side-by-side comparison of specifications, capabilities, and pricing.

Released2023-12-112024-07-23
Context window32K128K
Parameters8x7B405B
Architecturemixture of expertsdecoder only
LicenseApache 2.0Open Source
Knowledge cutoff2023-12

Capabilities

Vision
Multimodal
Reasoning
Function calling
Tool use
Structured Outputs
Code execution

Availability

Providers

Benchmarks

Google-Proof Q&A54.851.5HellaSwag90.995.8HumanEval80.589.0Massive Multitask Language Understanding80.288.6Chatbot Arena—1228.0