Llama 3.1 8B Instruct
- Family
- Llama 3.1
- Released
- 2024-07-23
- Context
- 128K
- Parameters
- 8B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-12
- Specialization
- general
- Openness
- Open weights
- License
- Llama 3 CommunityCommercial use: conditional
- Weights
- Available
- Code
- Unknown
- Training
- Fine-tuned
Large-scale open-source AI for social technologies.
Cheapest of 14 routes · DeepInfra
About
The Llama 3.1 8B Instruct model, released on July 23, 2024, is a multilingual large language model with 8 billion parameters, optimized for instruction-following tasks. It features an enhanced transformer architecture, supporting languages like English, German, French, and others. The model excels in dialogue applications, having been fine-tuned using supervised fine-tuning and reinforcement learning with human feedback. Trained on approximately 15 trillion tokens with a December 2023 data cutoff, it outperforms many existing open-source and closed chat models in various benchmarks.
Top use-case fit
Classification
Q/$ AProviders(14)
Compare all 14Compare API pricing across 14 tracked provider routes for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Cache | Route |
|---|---|---|---|---|
| DeepInfra | $0.020 | $0.050 | - | Serverless |
| Novita AI | $0.020 | $0.050 | - | Serverless |
| Featherless | $0.050 | $0.080 | - | Serverless |
| GroqCloud | $0.050 | $0.080 | - | Serverless |
| Hyperbolic AI Inference | $0.100 | $0.100 | - | Serverless |
| Fireworks AI | $0.200 | $0.200 | - | Serverless |
| AWS Bedrock | $0.220 | $0.220 | - | Serverless |
| OpenRouter | $0.220 | $0.220 | read $0.220 | Serverless |
| Vercel AI Gateway | $0.220 | $0.220 | - | Serverless |
| Replicate API | $0.250 | $0.250 | - | Serverless |
| Cloudflare Workers AI | $0.152 | $0.287 | - | Serverless |
| IBM watsonx | $0.150 | $0.500 | - | Serverless |
| Microsoft Foundry | $0.300 | $0.610 | - | Provisioned |
| Databricks Foundation Model Serving | - | - | - | ProvisionedPartial |
Deprecated provider routes(3)
| Provider | Status | Catalog ID |
|---|---|---|
| OctoAI API (Deprecated) | Deprecated | — |
| Together AI | Deprecated | — |
| NVIDIA NIM | Deprecated | meta/llama-3.1-8b-instruct |
Available via routers & gateways(8)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Helicone
GatewayObservability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache 2.0 open-source core with a managed hosted tier for logging and analytics.
Capabilities
Benchmark peer barsfor Classification
Benchmark scores(2)
Migration checks
No linked migration route is available for this model yet.
Rankings & picks(2)
Compare Llama 3.1 8B Instruct with other models
Comparison and alternatives
Browse all comparisons →Large-scale open-source AI for social technologies.
Cheapest of 14 routes · DeepInfra