Llama 3 70B Instruct — Available Providers
Last refreshed 2026-10-17. Next refresh: weekly.
Compare pricing and deployment options across 10 providers.
Monthly cost ranking
Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.
Traffic profile
US default
Cost bars
Cheapest
Hyperbolic AI Inference
$0.48 at the selected traffic profile.
Recipe-ready
Fireworks AI
Install, auth, and call snippets are available from curated provider snippet data.
Provider matrix
Region, SLA, and compliance rows are hidden until curated source fields exist.| Provider | Profile cost | Input / Output | Deploy | Recipe | Links |
|---|---|---|---|---|---|
| Hyperbolic AI Inference inference | $0.48 | $0.40 / $0.40 | Serverless | Docs only | |
| Novita AI inference | $0.66 | $0.51 / $0.74 | Serverless | Docs only | |
| Fireworks AI inference | $1.08 | $0.90 / $0.90 | Serverless | Snippets | |
| AWS Bedrock hyperscaler | $1.19 | $0.99 / $0.99 | Serverless | Snippets | |
| Replicate API marketplace | $1.20 | $0.65 / $2.75 | Serverless | Snippets | |
| GCP Vertex AI hyperscaler | $1.92 | $1.20 / $3.60 | Serverless | Snippets | |
| IBM watsonx platform | $2.16 | $1.80 / $1.80 | Serverless | Docs only | |
| Baseten API inference | Not enough pricing | - / - | Serverless | Docs only | |
| OCI Generative AI hyperscaler | Not enough pricing | - / - | Serverless | Docs only | |
| Scale AI GenAI Platform platform | Not enough pricing | - / - | Serverless | Docs only |
Llama 3 70B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.
Deprecated provider routes(8)
| Provider | Status | Catalog ID |
|---|---|---|
| Microsoft Foundry | DeprecatedRetired June 30, 2025 | — |
| NVIDIA NIM | DeprecatedRetired April 15, 2026 | meta/llama3-70b-instruct |
| DeepInfra | DeprecatedRetired September 11, 2025 | meta-llama/Meta-Llama-3-70B-Instruct |
| OctoAI API (Deprecated) | Deprecated | — |
| Databricks Foundation Model Serving | DeprecatedRetired February 27, 2026 | — |
| Lepton AI API | Deprecated | — |
| Together AI | DeprecatedRetired April 24, 2025 | — |
| OpenRouter | Deprecated | meta-llama/llama-3-70b-instruct |