Llama 3.1-405B
llama-3-1-405b
Last refreshed 2026-05-11. Next refresh: weekly.
Llama 3.1-405B is worth evaluating for rag, agents, and long context when its provider route and context window match the workload.
Decision context: Classification task fit, 2 tracked provider routes, and research from 2026-04-19.
Use it for
- Teams evaluating rag, agents, and long context
- Workloads that can use a 128k context window
- Buyers comparing 2 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
Cheapest output
$3.75
Replicate API per 1M tokens
Provider routes
2
Tracked API hosts
Quality / dollar
Grade D
Ranked by benchmark score divided by cheapest output price
Freshness
2026-04-19
Researched 29d ago
Top use-case fit
RAG
Included by capability and metadata signals in the decision map.
Agents
Included by capability and metadata signals in the decision map.
Long context
Included by capability and metadata signals in the decision map.
Provider price ladder
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Replicate API | $3.75 | $3.75 | Serverless |
| GCP Vertex AI | $5.00 | $16.00 | Serverless |
Benchmark peer barsfor Classification
Migration checks
No linked migration route is available for this model yet.
About
Meta's flagship Llama 3.1 model with 405B parameters and 128K context window. Open-weights model with strong reasoning and coding capabilities.
Llama 3.1-405B has a 128K-token context window.
Llama 3.1-405B input tokens at $3.75/1M, output at $3.75/1M.
Capabilities
Benchmark Scores(1)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| MMLU PRO | 73.2 | — | https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro |
