Llama 3 8B Instruct
Newer version available: Llama 3.1 8B Instruct
- Family
- Llama 3
- Released
- 2024-04-18
- Context
- 8K
- Parameters
- 8B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-03
- Specialization
- general
- Openness
- Open weights
- License
- Llama 3 CommunityRestricted
- Weights
- Available
- Code
- Unknown
- Training
- Fine-tuned
Large-scale open-source AI for social technologies.
Cheapest of 7 routes · Fireworks AI
About
The Llama 3 8B Instruct model, released on April 18, 2024, is Meta's latest instruction-following language model with 8 billion parameters. It utilizes an auto-regressive transformer architecture with Grouped-Query Attention for improved scalability. Trained on over 15 trillion tokens and fine-tuned with 10 million human-annotated examples, it excels in dialogue and conversational tasks. The model outperforms its predecessors on industry benchmarks, scoring 68.4 on MMLU (5-shot). Designed for commercial and research applications, it prioritizes safety and helpfulness, making it suitable for chatbots, virtual assistants, and other interactive AI applications. For more details, visit the Hugging Face page [1].
Providers(7)
Compare all 7Compare API pricing across 7 tracked provider routes for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Fireworks AI | $0.200 | $0.200 | Serverless |
| Replicate API | $0.050 | $0.250 | Serverless |
| GCP Vertex AI | $0.120 | $0.360 | Serverless |
| AWS Bedrock | $0.300 | $0.600 | Serverless Scheduled retirement: March 30, 2027 |
| Alibaba Cloud PAI-EAS | - | - | ServerlessPartial |
| Baseten API | - | - | ServerlessPartial |
| IBM watsonx | - | - | ServerlessPartial |
Deprecated provider routes(10)
| Provider | Status | Catalog ID |
|---|---|---|
| DeepInfra | DeprecatedRetired May 7, 2026 | meta-llama/Meta-Llama-3-8B-Instruct |
| OctoAI API (Deprecated) | Deprecated | — |
| Lepton AI API | Deprecated | — |
| Cloudflare Workers AI | Deprecated | @cf/meta/llama-3-8b-instruct |
| NVIDIA NIM | DeprecatedRetired April 15, 2026 | meta/llama3-8b-instruct |
| Together AI | DeprecatedRetired August 28, 2025 | — |
| Databricks Foundation Model Serving | DeprecatedRetired February 27, 2026 | — |
| Microsoft Foundry | DeprecatedRetired June 30, 2025 | — |
| OpenRouter | Deprecated | meta-llama/llama-3-8b-instruct |
| Novita AI | Deprecated | llama-3-8b-instruct |
Available via routers & gateways(16)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.
AIRouter
RouterCommercial LLM router that analyzes incoming requests and routes to the optimal model for cost/quality/latency via a drop-in OpenAI-compatible API, with a privacy-preserving embedding mode that avoids sending prompt content.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(8)
| Benchmark | Score | Version | Evaluation | Source |
|---|---|---|---|---|
| 44.8 | diamondObserved 2026-03-06 | — | ||
| 91.1 | 10-shotObserved 2026-03-06 | — | research | |
| 68.2 | pass@1Observed 2026-03-06 | — | research | |
| 76.9 | 5-shotObserved 2026-03-06 | — | ||
| 59.5 | v2Observed 2026-04-14 | — | ||
| 40.5 | —Observed 2026-04-14 | — | ||
| 80.6 | —Observed 2026-05-28 | — | ||
| 1224.0 | text_style_control overall 2026-10-22 (style control, default view)Observed 2026-10-26 | Configuration: Llama 3 8B Instruct Harness: LMArena blind pairwise human votes, Bradley-Terry Evaluator: LMArena Confidence: confirmed Notes: LMArena text style control leaderboard, overall category, published 2026-10-22 (HF lmarena-ai/leaderboard-dataset @9761a3ce, latest split). Board entry 'Llama 3 8B Instruct': rank 338, Arena Score 1223.7 (95% CI 1220.0-1227.4), 104642 votes. Retrieved 2026-10-26. | Source Source: LMArena (lmarena.ai), CC BY 4.0 |
Migration checks
No linked migration route is available for this model yet.
Rankings & picks(3)
Compare Llama 3 8B Instruct with other models
- Llama 3 8B Instruct vs DeepSeek V4 Flash157
- Llama 3 8B Instruct vs Qwen3.6-35B-A3B150
- Llama 3 8B Instruct vs Phi-3 Mini 4k146
- Llama 3 8B Instruct vs Claude Opus 4.6144
- Llama 3 8B Instruct vs Llama 3.1 70B Instruct140
- Llama 3 8B Instruct vs DeepSeek V4 Pro134
- Llama 3 8B Instruct vs Qwen3-Max122
- Llama 3 8B Instruct vs Llama 3.2 1B Instruct119
Comparison and alternatives
Browse all comparisons →Show all 50 popular comparisonssorted by 7-day search impressions
Large-scale open-source AI for social technologies.
Cheapest of 7 routes · Fireworks AI