Llama 3.1 405B Instruct — Available Providers
Last refreshed 2026-05-16. Next refresh: weekly.
Compare pricing and deployment options across 11 providers.
Monthly cost ranking
Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.
Traffic profile
US default
Cost bars
Cheapest
AWS Bedrock
$2.88 at the selected traffic profile.
Recipe-ready
AWS Bedrock
Install, auth, and call snippets are available from curated provider snippet data.
Provider matrix
Region, SLA, and compliance rows are hidden until curated source fields exist.| Provider | Profile cost | Input / Output | Deploy | Recipe | Links |
|---|---|---|---|---|---|
| AWS Bedrock hyperscaler | $2.88 | $2.40 / $2.40 | Serverless | Snippets | |
| Fireworks AI inference | $3.60 | $3.00 / $3.00 | Serverless | Snippets | |
| Hyperbolic AI Inference inference | $4.80 | $4.00 / $4.00 | Serverless | Docs only | |
| IBM watsonx platform | $4.80 | $3.00 / $9.00 | Serverless | Docs only | |
| OctoAI API (Deprecated) inference | $4.80 | $3.00 / $9.00 | Serverless | Docs only | |
| Together AI inference | $8.00 | $5.00 / $15.00 | Serverless | Snippets | |
| GCP Vertex AI hyperscaler | $8.20 | $5.00 / $16.00 | Serverless | Snippets | |
| Microsoft Foundry hyperscaler | $8.53 | $5.33 / $16.00 | Provisioned | Docs only | |
| Databricks Foundation Model Serving platform | Not enough pricing | - / - | Provisioned | Docs only | |
| NVIDIA NIM inference | Not enough pricing | - / - | Provisioned | Docs only | |
| Scale AI GenAI Platform platform | Not enough pricing | - / - | Serverless | Docs only |
Llama 3.1 405B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.