Llama 3.1-405B

Released
2024-07-23
Last refreshed
2026-10-12
Status
Researched 209d ago
Open weightsCommercial use: restrictedRAGAgentsLong contextClassificationJSON / Tool use
AI at Meta releases · 12 in the last 12 monthsChangelog →
Specifications
Family
Llama 3.1
Released
2024-07-23
Context
128K
Parameters
405B
Knowledge cutoff
2024-04
Openness
Open weights
License
Llama 3 CommunityRestricted
Weights
Available
Code
Unknown
Created by
AI at Meta

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website
Pricing
Output / 1M
$3.75
Input / 1M
$3.75

Cheapest of 2 routes · Replicate API

Providers(2)
GCP Vertex AIReplicate API
View 2 provider routes

About

Meta's flagship Llama 3.1 model with 405B parameters and 128K context window. Open-weights model with strong reasoning and coding capabilities.

Providers(2)

Compare all 2

Compare API pricing across 2 tracked provider routes for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MRoute
Replicate API$3.75$3.75
Serverless
GCP Vertex AI$5.00$16.00
Serverless

Available via routers & gateways(13)

LiteLLM

Gateway

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

Free OSSGCP Vertex AI

OpenRouter

Hybrid

Unified hybrid gateway to 500+ models from 80+ providers via a single OpenAI-compatible API, with an optional Auto Router that selects a model per prompt from market spend data.

Passthrough + feeGCP Vertex AI

Portkey

Gateway

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, caching, and guardrails; MIT-licensed open-source core is self-hostable. Now part of Palo Alto Networks as Prisma AIRS AI Gateway.

SubscriptionGCP Vertex AI

AIRouter

Router

Commercial LLM router (branded "AI Router" on its site) that picks the best model per request via a Decision API or an OpenAI-compatible Chat Completions endpoint, with a private selection mode that routes on anonymized patterns; sold as BYOK subscription plans priced by routed tokens.

SubscriptionGCP Vertex AI

Helicone

Gateway

Observability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache-2.0 open-source platform with a managed hosted tier for logging and analytics.

SubscriptionGCP Vertex AI

Kong AI Gateway

Gateway

Multi-LLM AI gateway built on Kong Gateway 3.x, adding semantic routing, load balancing, guardrails, and MCP traffic analytics as plugins over Kong's existing API management platform.

SubscriptionGCP Vertex AI

Capabilities

JSON / Tool useStructured OutputsFine-tuning

Benchmark peer barsfor Classification

MMLU PRORank 77 of 122
Gemini 3 Pro
91.8
Gemini 3.1 Pro Preview
91.0
Qwen3.7-Max
89.6
Claude Opus 4.6
89.1
Llama 3.1-405Bcurrent
73.2

Benchmark scores(1)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.
BenchmarkScoreVersionEvaluationSource
MMLU PRO
73.2—Observed 2026-04-14—
Source

Migration checks

No linked migration route is available for this model yet.