Llama 3.1 405B Instruct

Name: Llama 3.1 405B Instruct
Author: AI at Meta

Released

2024-07-23

Last refreshed

2026-10-12

Status

Researched 180d ago

Open weightsCommercial use: conditionalRAGLong contextClassificationJSON / Tool use

AI at Meta releases · 11 in the last 12 monthsChangelog →

Specifications

Family: Llama 3.1
Released: 2024-07-23
Context: 128K
Parameters: 405B
Architecture: Decoder Only
Knowledge cutoff: 2023-12
Specialization: general
Openness: Open weights
License: Llama 3 CommunityCommercial use: conditional
Weights: Available
Code: Unknown
Training: Fine-tuned

Created by

AI at Meta

Large-scale open-source AI for social technologies.

Menlo Park, California, United States

Founded 2013

Website

Pricing

Output / 1M

$2.40

Input / 1M

$2.40

Cheapest of 7 routes · AWS Bedrock

Providers(7)

Fireworks AI IBM watsonx Scale AI GenAI Platform Microsoft Foundry Hyperbolic AI Inference AWS Bedrock GCP Vertex AI

View 7 provider routes

About

Llama 3.1 405B Instruct is Meta's advanced large language model released on July 23, 2024, featuring 405 billion parameters. It utilizes an optimized transformer architecture with supervised fine-tuning and reinforcement learning for enhanced instruction-following capabilities. The model supports multiple languages, was trained on 15 trillion tokens, and fine-tuned with 25 million synthetic examples. It excels in multilingual dialogue and text generation, making it ideal for assistant-like applications. Llama 3.1 incorporates robust safety measures and ethical considerations, outperforming many existing models on various industry benchmarks.

Providers(7)

Compare all 7

Compare API pricing across 7 tracked provider routes for input and output tokens, batch, and cached reads when available.

Provider	Input / 1M	Output / 1M	Route
AWS Bedrock	$2.40	$2.40	Serverless
Fireworks AI	$3.00	$3.00	Serverless
Hyperbolic AI Inference	$4.00	$4.00	Serverless
IBM watsonx	$3.00	$9.00	Serverless
GCP Vertex AI	$5.00	$16.00	Serverless
Microsoft Foundry	$5.33	$16.00	Provisioned
Scale AI GenAI Platform	-	-	ServerlessPartial

Deprecated provider routes(4)

Provider	Status	Catalog ID
OctoAI API (Deprecated)	Deprecated	—
Together AI	Deprecated	—
NVIDIA NIM	Deprecated	—
Databricks Foundation Model Serving	Deprecated	—

Available via routers & gateways(16)

LiteLLM

Gateway

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

Free OSSGCP Vertex AIMicrosoft Foundry

OpenRouter

Hybrid

Unified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.

PassthroughGCP Vertex AITogether AIFireworks AI

Portkey

Gateway

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.

SubscriptionGCP Vertex AIMicrosoft Foundry

AIRouter

Router

Commercial LLM router that analyzes incoming requests and routes to the optimal model for cost/quality/latency via a drop-in OpenAI-compatible API, with a privacy-preserving embedding mode that avoids sending prompt content.

Passthrough + feeGCP Vertex AI

Amazon Bedrock Intelligent Prompt Routing

Router

AWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.

PassthroughAWS Bedrock

Azure AI Foundry Model Router

Router

Microsoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.

PassthroughMicrosoft Foundry

Capabilities

Structured Outputs

Benchmark peer barsfor Classification

Massive Multitask Language UnderstandingRank 14 of 100

Gemini 3.1 Pro Preview

98.0

Clef-omni

92.7

GPT-5.5

92.4

Clef-flash

91.8

Llama 3.1 405B Instructcurrent

88.6

Benchmark scores(1)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.