LLM ReferenceLLM Reference
Replicate API

Llama 3.1-405B on Replicate API

Llama 3.1 · AI at Meta

ServerlessOpen Source

Last refreshed 2026-04-19. Next refresh: weekly.

Why use Llama 3.1-405B on Replicate API?

Replicate API offers Llama 3.1-405B with pay-as-you-go pricing at $3.75/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Compare Llama 3.1-405B across 2 providers to find the best fit for your use case
Input / 1M
$3.75
Output / 1M
$3.75
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install replicate
Auth
export REPLICATE_API_TOKEN=...
Call
import replicate
output = replicate.run(
    "llama-3-1-405b",
    input={"prompt": "Hello"}
Model ID
llama-3-1-405b

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# llama-3-1-405b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "llama-3-1-405b",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

  • Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
  • The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.

Compare Llama 3.1-405B Across Providers

ProviderInput (per 1M)Output (per 1M)
GCP Vertex AI$5.00$16.00
Replicate API$3.75$3.75

Pricing

TypePrice (per 1M)
Input tokens$3.75
Output tokens$3.75

Capabilities

Function CallingTool UseStructured Outputs

About Llama 3.1-405B

Meta's flagship Llama 3.1 model with 405B parameters and 128K context window. Open-weights model with strong reasoning and coding capabilities.

FAQ

What does Llama 3.1-405B cost on Replicate API?

On Replicate API, Llama 3.1-405B costs $3.75 per 1M input tokens and $3.75 per 1M output tokens.

What is the context window for Llama 3.1-405B on Replicate API?

Llama 3.1-405B supports a 128,000 token context window on Replicate API.

How does Replicate API compare to other Llama 3.1-405B providers?

Llama 3.1-405B is available from 2 providers. The cheapest input pricing is $3.75/1M tokens from Replicate API.

Who created Llama 3.1-405B?

Llama 3.1-405B was created by AI at Meta as part of the Llama 3.1 model family.

Is Llama 3.1-405B open source?

Llama 3.1-405B is open source according to the seed data.

Get Started

Model Specs

Released2024-07-23
Parameters405B
Context128k
Knowledge cutoff2024-04

Related Models on Replicate API