Last refreshed 2026-04-15. Next refresh: weekly.
Why use Llama 3.1-70B on Replicate API?
Replicate API offers Llama 3.1-70B with pay-as-you-go pricing at $1.20/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.
Input / 1M
$1.20
Output / 1M
$1.20
Cache
Not sourced
Batch
Not sourced
Setup recipe
Python + curlInstall
pip install replicateAuth
export REPLICATE_API_TOKEN=...Call
import replicate
output = replicate.run(
"llama-3-1-70b",
input={"prompt": "Hello"}Model ID
llama-3-1-70bRequest example
import replicate
# reads REPLICATE_API_TOKEN from env
# llama-3-1-70b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
"llama-3-1-70b",
input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))Gotchas
- Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
- The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $1.20 |
| Output tokens | $1.20 |
Capabilities
Function CallingTool Use
About Llama 3.1-70B
Medium-sized Llama 3.1 model balancing performance and efficiency. Excellent for deployment with strong capability retention.
FAQ
What does Llama 3.1-70B cost on Replicate API?
On Replicate API, Llama 3.1-70B costs $1.2 per 1M input tokens and $1.2 per 1M output tokens.
What is the context window for Llama 3.1-70B on Replicate API?
Llama 3.1-70B supports a 128,000 token context window on Replicate API.
Who created Llama 3.1-70B?
Llama 3.1-70B was created by AI at Meta as part of the Llama 3.1 model family.
Is Llama 3.1-70B open source?
Llama 3.1-70B is open source according to the seed data.
Get Started
Model Specs
Released2024-07-23
Parameters70B
Context128k
Knowledge cutoff2024-04