Llama 3 70B Instruct — Available Providers

Last refreshed 2026-10-17. Next refresh: weekly.

Compare pricing and deployment options across 10 providers.

Monthly cost ranking

Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.

Traffic profile
US default
10 providers

Provider matrix

Region, SLA, and compliance rows are hidden until curated source fields exist.
Input / Output$0.40 / $0.40
Serverless
Novita AI
inference
$0.66
Input / Output$0.51 / $0.74
Serverless
Fireworks AI
inference
$1.08
Input / Output$0.90 / $0.90
ServerlessSnippets
AWS Bedrock
hyperscaler
$1.19
Input / Output$0.99 / $0.99
ServerlessSnippets
Replicate API
marketplace
$1.20
Input / Output$0.65 / $2.75
ServerlessSnippets
GCP Vertex AI
hyperscaler
$1.92
Input / Output$1.20 / $3.60
ServerlessSnippets
IBM watsonx
platform
$2.16
Input / Output$1.80 / $1.80
Serverless
Baseten API
inference
Not enough pricing
Input / Output- / -
Serverless
Not enough pricing
Input / Output- / -
Serverless
Not enough pricing
Input / Output- / -
Serverless
Llama 3 70B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.

Deprecated provider routes(8)

ProviderStatusCatalog ID
Microsoft Foundry
DeprecatedRetired June 30, 2025
—
NVIDIA NIM
DeprecatedRetired April 15, 2026
meta/llama3-70b-instruct
DeepInfra
DeprecatedRetired September 11, 2025
meta-llama/Meta-Llama-3-70B-Instruct
OctoAI API (Deprecated)
Deprecated
—
Databricks Foundation Model Serving
DeprecatedRetired February 27, 2026
—
Lepton AI API
Deprecated
—
Together AI
DeprecatedRetired April 24, 2025
—
OpenRouter
Deprecated
meta-llama/llama-3-70b-instruct

Llama 3 70B Instruct

Context8K
Parameters70B
Released2024-04-18