LLM ReferenceLLM Reference

Llama 3.1 70B Instruct — Available Providers

Last refreshed 2026-05-16. Next refresh: weekly.

Compare pricing and deployment options across 11 providers.

Monthly cost ranking

Ranked for 1M input and 0.2M output tokens per month. Cache and batch discounts are applied only when the provider row has sourced prices.

Traffic profile
US default
11 providers

Provider matrix

Region, SLA, and compliance rows are hidden until curated source fields exist.
DeepInfra
inference
$0.48
Input / Output$0.40 / $0.40
ServerlessSnippets
Input / Output$0.40 / $0.40
Serverless
OpenRouter
aggregator
$0.48
Input / Output$0.40 / $0.40
Serverless
AWS Bedrock
hyperscaler
$0.86
Input / Output$0.72 / $0.72
ServerlessSnippets
Together AI
inference
$1.06
Input / Output$0.88 / $0.88
ServerlessSnippets
Fireworks AI
inference
$1.08
Input / Output$0.90 / $0.90
ServerlessSnippets
Input / Output$0.90 / $0.90
Serverless
IBM watsonx
platform
$1.28
Input / Output$0.80 / $2.40
Serverless
$3.39
Input / Output$2.68 / $3.54
Provisioned
Not enough pricing
Input / Output- / -
Provisioned
NVIDIA NIM
inference
Not enough pricing
Input / Output- / -
Provisioned
Llama 3.1 70B Instruct operational data note: this page ranks sourced token, cache, and batch fields only. Region, SLA, compliance, and latency claims are intentionally omitted until a curated matrix is added.