What is the context window of Llama 3.1-70B?

Llama 3.1-70B has a context window of 128k tokens.

How much does Llama 3.1-70B cost?

Llama 3.1-70B is available at $1.2/1M input tokens through Replicate API.

When was Llama 3.1-70B released?

Llama 3.1-70B was released on 2024-07-23.

Which providers offer Llama 3.1-70B?

Llama 3.1-70B is available from 1 provider: Replicate API.

What benchmarks has Llama 3.1-70B been tested on?

Llama 3.1-70B has been evaluated on 1 benchmark, including MMLU PRO.

Llama 3.1-70B

Name: Llama 3.1-70B
Author: AI at Meta

llama-3-1-70b

Researched 137d ago

Last refreshed 2026-04-15. Next refresh: weekly.

Open SourceRAGAgentsLong contextClassificationJSON / Tool use

Llama 3.1-70B is worth evaluating for rag, agents, and long context when its provider route and context window match the workload.
Decision context: Classification task fit, 1 tracked provider route, and research from 2026-01-01.

Use it for

Teams evaluating rag, agents, and long context
Workloads that can use a 128k context window
Buyers comparing 1 tracked provider route

Do not use it for

Vision or document-understanding workloads

Cheapest output

$1.20

Replicate API per 1M tokens

Provider routes

Tracked API hosts

Quality / dollar

Grade C

Ranked by benchmark score divided by cheapest output price

Freshness

2026-01-01

Researched 137d ago

stale

Top use-case fit

RAG

Included by capability and metadata signals in the decision map.

Agents

Included by capability and metadata signals in the decision map.

Long context

Included by capability and metadata signals in the decision map.

Provider price ladder

Provider	Input / 1M	Output / 1M	Route
Replicate API	$1.20	$1.20	Serverless

Benchmark peer barsfor Classification

MMLU PRORank 46 of 64

90.1

89.1

88.9

88.6

67.6

Migration checks

No linked migration route is available for this model yet.

About

Medium-sized Llama 3.1 model balancing performance and efficiency. Excellent for deployment with strong capability retention.

Llama 3.1-70B has a 128K-token context window.

Llama 3.1-70B input tokens at $1.2/1M, output at $1.2/1M.

Capabilities

Function CallingTool Use

Benchmark Scores(1)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.