Llama 2 13B Chat
Llama 2 13B Chat is worth evaluating for coding, classification, and json / tool use when its provider route and context window match the workload.
Use it for
- Teams evaluating coding, classification, and json / tool use
- Workloads that can use a 4k context window
- Buyers comparing 4 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Family
- Llama 2
- Released
- 2023-07-18
- Context
- 4k
- Parameters
- 13B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2022-09
- Specialization
- general
- Openness
- Open weights
- License
- Llama 2 CommunityCommercial use: conditional
- Weights
- Available
- Code
- Unknown
- Training
- Fine-tuned
Large-scale open-source AI for social technologies.
Cheapest of 11 routes · DeepInfra
About
The Llama 2 13B Chat model is a 13 billion parameter generative text model developed by Meta, optimized for conversational applications. Released on July 18, 2023, it's part of the Llama 2 family and excels in dialogue scenarios. The model leverages supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to generate coherent and contextually relevant responses. Trained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and matches popular closed-source models in helpfulness and safety. This model is ideal for AI engineers working on chatbots, virtual assistants, and customer service automation. For more details, visit the model's Hugging Face page [1].
Llama 2 13B Chat is an open-weight model in the Llama 2 family. The structured metadata tracks a 4k-token context window and structured outputs. This page tracks provider routes through Alibaba Cloud PAI-EAS, AWS Bedrock, Microsoft Foundry, and 8 more, with the cheapest tracked route listed at $0.1 input and $0.5 output per 1M tokens. Headline tracked benchmarks include Google-Proof Q&A 41.8, HellaSwag 88.5, and HumanEval 59.3.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ A1 relevant benchmark in the decision map.
Classification
Q/$ A2 relevant benchmarks in the decision map.
JSON / Tool use
Included by capability and metadata signals in the decision map.
Provider price ladder
Compare all 11Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| DeepInfra | $0.130 | $0.130 | Serverless |
| Lepton AI API | $0.130 | $0.130 | Serverless |
| Fireworks AI | $0.200 | $0.200 | Serverless |
| Together AI | $0.300 | $0.300 | Serverless |
Available via routers & gateways(15)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.
AIRouter
RouterCommercial LLM router that analyzes incoming requests and routes to the optimal model for cost/quality/latency via a drop-in OpenAI-compatible API, with a privacy-preserving embedding mode that avoids sending prompt content.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(4)
| Benchmark | Score | Version | Evaluation | Source |
|---|---|---|---|---|
| Google-Proof Q&A | 41.8 | diamondObserved 2026-03-06 | — | Source |
| HellaSwag | 88.5 | 10-shotObserved 2026-03-06 | — | Source |
| HumanEval | 59.3 | pass@1Observed 2026-03-06 | — | Source |
| Massive Multitask Language Understanding | 71.2 | 5-shotObserved 2026-03-06 | — | Source |
Migration checks
No linked migration route is available for this model yet.
Compare Llama 2 13B Chat with other models
Comparison and alternatives
Browse all comparisons →Show all 24 popular comparisonssorted by 7-day search impressions
Frequently asked questions
What is the context window of Llama 2 13B Chat?
Llama 2 13B Chat has a context window of 4k tokens.
How much does Llama 2 13B Chat cost?
Llama 2 13B Chat pricing ranges from $0.10/1M to $0.95/1M input tokens depending on the provider.
When was Llama 2 13B Chat released?
Llama 2 13B Chat was released on 2023-07-18.
Which providers offer Llama 2 13B Chat?
Llama 2 13B Chat is available from 11 providers: Alibaba Cloud PAI-EAS, AWS Bedrock, Microsoft Foundry, GCP Vertex AI, DeepInfra, Lepton AI API, Together AI, Databricks Foundation Model Serving, IBM watsonx, Fireworks AI, Replicate API.
What benchmarks has Llama 2 13B Chat been tested on?
Llama 2 13B Chat has been evaluated on 4 benchmarks, including Google-Proof Q&A, HellaSwag, HumanEval, Massive Multitask Language Understanding.
Large-scale open-source AI for social technologies.
Cheapest of 11 routes · DeepInfra