Llama 3 70B Instruct — Available Providers
Last refreshed 2026-05-16. Next refresh: weekly.
Compare pricing and deployment options across 17 providers.
Monthly cost ranking
Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.
Traffic profile
US default
Cost bars
Cheapest
Hyperbolic AI Inference
$0.48 at the selected traffic profile.
Recipe-ready
DeepInfra
Install, auth, and call snippets are available from curated provider snippet data.
Provider matrix
Region, SLA, and compliance rows are hidden until curated source fields exist.| Provider | Profile cost | Input / Output | Deploy | Recipe | Links |
|---|---|---|---|---|---|
| Hyperbolic AI Inference inference | $0.48 | $0.40 / $0.40 | Serverless | Docs only | |
| DeepInfra inference | $0.58 | $0.45 / $0.65 | Serverless | Snippets | |
| OpenRouter aggregator | $0.66 | $0.51 / $0.74 | Serverless | Docs only | |
| Lepton AI API inference | $0.96 | $0.80 / $0.80 | Serverless | Docs only | |
| Together AI inference | $1.06 | $0.88 / $0.88 | Serverless | Snippets | |
| Fireworks AI inference | $1.08 | $0.90 / $0.90 | Serverless | Snippets | |
| OctoAI API (Deprecated) inference | $1.08 | $0.90 / $0.90 | Serverless | Docs only | |
| AWS Bedrock hyperscaler | $1.19 | $0.99 / $0.99 | Serverless | Snippets | |
| Replicate API marketplace | $1.20 | $0.65 / $2.75 | Serverless | Snippets | |
| Databricks Foundation Model Serving platform | $1.60 | $1.00 / $3.00 | Serverless | Docs only | |
| GCP Vertex AI hyperscaler | $1.92 | $1.20 / $3.60 | Serverless | Snippets | |
| IBM watsonx platform | $2.16 | $1.80 / $1.80 | Serverless | Docs only | |
| Microsoft Foundry hyperscaler | $6.05 | $3.78 / $11.34 | ServerlessProvisioned | Docs only | |
| Baseten API inference | Not enough pricing | - / - | Serverless | Docs only | |
| NVIDIA NIM inference | Not enough pricing | - / - | Provisioned | Docs only | |
| OCI Generative AI hyperscaler | Not enough pricing | - / - | Serverless | Docs only | |
| Scale AI GenAI Platform platform | Not enough pricing | - / - | Serverless | Docs only |
Llama 3 70B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.