Llama 3.1 8B Instruct — Available Providers
Last refreshed 2026-11-10. Next refresh: weekly.
Compare pricing and deployment options across 12 providers.
Monthly cost ranking
Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.
Traffic profile
US default
Cost bars
Cheapest
DeepInfra
$0.03 at the selected traffic profile.
Cache-heavy
OpenRouter
Cache read is sourced at $0.22/1M.
Recipe-ready
DeepInfra
Install, auth, and call snippets are available from curated provider snippet data.
Provider matrix
Region, SLA, and compliance rows are hidden until curated source fields exist.| Provider | Profile cost | Input / Output | Cache | Deploy | Recipe | Links |
|---|---|---|---|---|---|---|
| DeepInfra inference | $0.03 | $0.020 / $0.050 | - | Serverless | Snippets | |
| Novita AI inference | $0.03 | $0.020 / $0.050 | - | Serverless | Docs only | |
| Featherless inference | $0.07 | $0.050 / $0.080 | - | Serverless | Snippets | |
| GroqCloud inference | $0.07 | $0.050 / $0.080 | - | Serverless | Docs only | |
| Hyperbolic AI Inference inference | $0.12 | $0.10 / $0.10 | - | Serverless | Docs only | |
| Cloudflare Workers AI inference | $0.21 | $0.152 / $0.287 | - | Serverless | Docs only | |
| Fireworks AI inference | $0.24 | $0.20 / $0.20 | - | Serverless | Snippets | |
| AWS Bedrock hyperscaler | $0.26 | $0.22 / $0.22 | - | Serverless | Snippets | |
| OpenRouter aggregator | $0.26 | $0.22 / $0.22 | read $0.22 | Serverless | Docs only | |
| Vercel AI Gateway gateway | $0.26 | $0.22 / $0.22 | - | Serverless | Snippets | |
| Replicate API marketplace | $0.30 | $0.25 / $0.25 | - | Serverless | Snippets | |
| Databricks Foundation Model Serving platform | Not enough pricing | - / - | - | Provisioned | Docs only |
Llama 3.1 8B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.
Deprecated provider routes(5)
| Provider | Status | Catalog ID |
|---|---|---|
| OctoAI API (Deprecated) | Deprecated | — |
| Together AI | DeprecatedRetired March 6, 2026 | meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo |
| NVIDIA NIM | DeprecatedRetired August 25, 2026 | meta/llama-3.1-8b-instruct |
| Microsoft Foundry | DeprecatedRetired June 13, 2026 | Meta-Llama-3.1-8B-Instruct |
| IBM watsonx | DeprecatedRetired May 30, 2025 | — |