Llama 3.2 3B Instruct
Llama 3.2 3B Instruct is worth evaluating for rag, long context, and classification when its provider route and context window match the workload.
Use it for
- Teams evaluating rag, long context, and classification
- Workloads that can use a 128k context window
- Buyers comparing 4 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Family
- Llama 3.2
- Released
- 2024-09-25
- Context
- 128k
- Parameters
- 3.21B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-12
- Specialization
- general
- Openness
- Open weights
- License
- Llama 3 CommunityCommercial use: conditional
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Large-scale open-source AI for social technologies.
Cheapest of 7 routes · Novita AI
About
Llama 3.2 3B Instruct is Meta's Llama 3.2 model. It offers a 128K-token context window with weights openly available for self-hosting and scores 34.7 on MMLU PRO.
Top use-case fit
RAG
Included by capability and metadata signals in the decision map.
Long context
Included by capability and metadata signals in the decision map.
Classification
Q/$ A1 relevant benchmark in the decision map.
Provider price ladder
Compare all 7Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Novita AI | $0.030 | $0.050 | Serverless |
| Fireworks AI | $0.100 | $0.100 | Serverless |
| AWS Bedrock | $0.150 | $0.150 | Serverless |
| Vercel AI Gateway | $0.150 | $0.150 | Serverless |
Available via routers & gateways(3)
OpenRouter
HybridUnified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.
NVIDIA LLM Router Blueprint
RouterNVIDIA's open-source AI blueprint for LLM routing that selects the optimal model per prompt via intent classification or neural auto-routing; being deprecated 2026-06-20.
Capabilities
Benchmark peer barsfor Classification
Benchmark scores(2)
Migration checks
No linked migration route is available for this model yet.
Large-scale open-source AI for social technologies.
Cheapest of 7 routes · Novita AI