Llama 3.1-70B on Replicate API

Name: Llama 3.1-70B on Replicate API
Brand: AI at Meta
SKU: llama-3-1-70b-replicate
Price: 1.2 USD

Llama 3.1 · AI at Meta

ServerlessOpen Weights

Last refreshed 2026-09-18. Next refresh: weekly.

Why use Llama 3.1-70B on Replicate API?

Replicate API offers Llama 3.1-70B with pay-as-you-go pricing at $1.20/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Input / 1M

$1.20

Output / 1M

$1.20

Cache

Not sourced

Batch

Not sourced

Setup recipe

Python + curl

Install

pip install replicate

Auth

export REPLICATE_API_TOKEN=...

Call

import replicate
output = replicate.run(
    "llama-3-1-70b",
    input={"prompt": "Hello"}

Model ID

llama-3-1-70b

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# llama-3-1-70b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "llama-3-1-70b",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.