Llama 3.1 405B Instruct — Available Providers
Last refreshed 2026-10-12. Next refresh: weekly.
Compare pricing and deployment options across 5 providers.
Monthly cost ranking
Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.
Traffic profile
US default
Cost bars
Cheapest
AWS Bedrock
$2.88 at the selected traffic profile.
Recipe-ready
AWS Bedrock
Install, auth, and call snippets are available from curated provider snippet data.
Provider matrix
Region, SLA, and compliance rows are hidden until curated source fields exist.| Provider | Profile cost | Input / Output | Deploy | Recipe | Links |
|---|---|---|---|---|---|
| AWS Bedrock hyperscaler | $2.88 | $2.40 / $2.40 | Serverless | Snippets | |
| Fireworks AI inference | $3.60 | $3.00 / $3.00 | Serverless | Snippets | |
| Hyperbolic AI Inference inference | $4.80 | $4.00 / $4.00 | Serverless | Docs only | |
| GCP Vertex AI hyperscaler | $8.20 | $5.00 / $16.00 | Serverless | Snippets | |
| Scale AI GenAI Platform platform | Not enough pricing | - / - | Serverless | Docs only |
Llama 3.1 405B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.
Deprecated provider routes(6)
| Provider | Status | Catalog ID |
|---|---|---|
| OctoAI API (Deprecated) | Deprecated | — |
| Together AI | DeprecatedRetired February 6, 2026 | meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo |
| IBM watsonx | DeprecatedRetired March 31, 2026 | — |
| NVIDIA NIM | Deprecated | — |
| Microsoft Foundry | DeprecatedRetired June 13, 2026 | Meta-Llama-3.1-405B-Instruct |
| Databricks Foundation Model Serving | DeprecatedRetired May 15, 2026 | — |