Llama 3.1 70B Instruct

Newer version available: Llama 3.3 70B Instruct

Released
2024-07-23
Last refreshed
2026-10-17
Status
Researched today
Open weightsCommercial use: restrictedCodingRAGLong contextClassificationJSON / Tool use
AI at Meta releases · 10 in the last 12 monthsChangelog →
Specifications
Family
Llama 3.1
Released
2024-07-23
Context
128K
Parameters
70B
Architecture
Decoder Only
Knowledge cutoff
2023-12
Specialization
general
Openness
Open weights
License
Llama 3 CommunityRestricted
Weights
Available
Code
Unknown
Training
Fine-tuned
Created by
AI at Meta

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website
Pricing
Output / 1M
$0.400
Input / 1M
$0.400

Cheapest of 8 routes · DeepInfra

Providers(8)
Fireworks AIDatabricks Foundation Model ServingHyperbolic AI InferenceDeepInfraOpenRouterAWS BedrockVercel AI GatewayFeatherless
View 8 provider routes

About

The Llama 3.1 70B Instruct model is a cutting-edge large language model with 70 billion parameters, designed for instruction-following tasks. It features multilingual capabilities, supporting languages like English, German, French, and others. Fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), it excels in understanding and responding to user instructions. The model can handle a context length of up to 128k tokens, making it suitable for complex dialogue systems and applications requiring detailed responses.

Top use-case fit: coding, agents, and build tasks

Coding

Q/$ B

Providers(8)

Compare all 8

Compare API pricing across 8 tracked provider routes for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MRoute
DeepInfra$0.400$0.400
Serverless
Hyperbolic AI Inference$0.400$0.400
Serverless
OpenRouter$0.400$0.400
Serverless
AWS Bedrock$0.720$0.720
Serverless
Featherless$0.720$0.720
Serverless
Vercel AI Gateway$0.720$0.720
Serverless
Fireworks AI$0.900$0.900
Serverless
Databricks Foundation Model Serving--
ProvisionedPartial

Deprecated provider routes(6)

ProviderStatusCatalog ID
Cloudflare Workers AIDeprecated@cf/meta/llama-3.1-70b-instruct
OctoAI API (Deprecated)Deprecated—
Together AIDeprecated—
NVIDIA NIMDeprecatedmeta/llama-3.1-70b-instruct
Microsoft FoundryDeprecated—
IBM watsonxDeprecated—

Available via routers & gateways(8)

LiteLLM

Gateway

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

Free OSSMicrosoft Foundry

OpenRouter

Hybrid

Unified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.

PassthroughTogether AIFireworks AI

Portkey

Gateway

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.

SubscriptionMicrosoft Foundry

Amazon Bedrock Intelligent Prompt Routing

Router

AWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.

PassthroughAWS Bedrock

Azure AI Foundry Model Router

Router

Microsoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.

PassthroughMicrosoft Foundry

Helicone

Gateway

Observability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache 2.0 open-source core with a managed hosted tier for logging and analytics.

SubscriptionMicrosoft Foundry

Capabilities

Structured Outputs

Benchmark peer barsfor Coding

HumanEvalRank 35 of 99
Claude Sonnet 4.6
98.0
o3
96.7
Claude Opus 4.6
95.0
Grok-3
94.5
Llama 3.1 70B Instructcurrent
84.1

Benchmark scores(3)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.
BenchmarkScoreVersionEvaluationSource
HellaSwag
94.210-shotObserved 2026-03-06—
Source
HumanEval
84.1pass@1Observed 2026-03-06—
Source
Massive Multitask Language Understanding
86.05-shotObserved 2026-03-06—
Source

Migration checks

No linked migration route is available for this model yet.

Compare Llama 3.1 70B Instruct with other models

Show all 27 popular comparisonssorted by 7-day search impressions
Llama 3.1 70B Instruct vs Kimi K2.545Llama 3.1 70B Instruct vs Claude Opus 4.643Llama 3.1 70B Instruct vs DeepSeek V4 Flash42Llama 3.1 70B Instruct vs GLM-5.140Llama 3.1 70B Instruct vs DeepSeek R140Llama 3.1 70B Instruct vs Nano Banana (Gemini 2.5 Flash Image)32Llama 3.1 70B Instruct vs GPT-5.427Llama 3.1 70B Instruct vs Claude Haiku 4.525Llama 3.1 70B Instruct vs o3 Mini23Llama 3.1 70B Instruct vs Phi-4 Mini Flash Reasoning22Llama 3.1 70B Instruct vs Claude Opus 4.519Llama 3.1 70B Instruct vs GLM-519Llama 3.1 70B Instruct vs Gemini 2.5 Pro18Llama 3.1 70B Instruct vs GPT-5.4 Pro18Llama 3.1 70B Instruct vs o317Llama 3.1 70B Instruct vs Llama 3.2 1B Instruct16Llama 3.1 70B Instruct vs Mistral Nemotron14Llama 3.1 70B Instruct vs DeepSeek V3.114Llama 3.1 70B Instruct vs DeepSeek V3.213Llama 3.1 70B Instruct vs Qwen3.5-397B-A17B12Llama 3.1 70B Instruct vs Claude 3.7 Sonnet12Llama 3.1 70B Instruct vs Qwen3-235B-A22B8Llama 3.1 70B Instruct vs Code Davinci 0018Llama 3.1 70B Instruct vs GPT-5.27Llama 3.1 70B Instruct vs Grok 3 Mini3Llama 3.1 70B Instruct vs GPT-5.2 Codex2Llama 3.1 70B Instruct vs Gemini 2.5 Pro Preview 05-062