Llama 2 13B Chat
- Family
- Llama 2
- Released
- 2023-07-18
- Context
- 4K
- Parameters
- 13B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2022-09
- Specialization
- general
- Openness
- Open weights
- License
- Llama 2 CommunityRestricted
- Weights
- Available
- Code
- Unknown
- Training
- Fine-tuned
Large-scale open-source AI for social technologies.
Cheapest of 7 routes · Fireworks AI
About
The Llama 2 13B Chat model is a 13 billion parameter generative text model developed by Meta, optimized for conversational applications. Released on July 18, 2023, it's part of the Llama 2 family and excels in dialogue scenarios. The model leverages supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to generate coherent and contextually relevant responses. Trained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and matches popular closed-source models in helpfulness and safety. This model is ideal for AI engineers working on chatbots, virtual assistants, and customer service automation.
Providers(7)
Compare all 7Compare API pricing across 7 tracked provider routes for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Fireworks AI | $0.200 | $0.200 | Serverless |
| GCP Vertex AI | $0.160 | $0.480 | Serverless |
| Replicate API | $0.100 | $0.500 | Serverless |
| IBM watsonx | $0.600 | $0.600 | Serverless |
| Microsoft Foundry | $0.810 | $0.940 | ServerlessProvisioned |
| AWS Bedrock | $0.750 | $1.00 | Serverless |
| Alibaba Cloud PAI-EAS | - | - | ServerlessPartial |
Deprecated provider routes(4)
| Provider | Status | Catalog ID |
|---|---|---|
| DeepInfra | Deprecated | meta-llama/Llama-2-13b-chat-hf |
| Lepton AI API | Deprecated | — |
| Together AI | Deprecated | — |
| Databricks Foundation Model Serving | Deprecated | — |
Available via routers & gateways(15)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.
AIRouter
RouterCommercial LLM router that analyzes incoming requests and routes to the optimal model for cost/quality/latency via a drop-in OpenAI-compatible API, with a privacy-preserving embedding mode that avoids sending prompt content.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(4)
| Benchmark | Score | Version | Evaluation | Source |
|---|---|---|---|---|
| Google-Proof Q&A | 41.8 | diamondObserved 2026-03-06 | — | Source |
| HellaSwag | 88.5 | 10-shotObserved 2026-03-06 | — | Source |
| HumanEval | 59.3 | pass@1Observed 2026-03-06 | — | Source |
| Massive Multitask Language Understanding | 71.2 | 5-shotObserved 2026-03-06 | — | Source |
Migration checks
No linked migration route is available for this model yet.
Compare Llama 2 13B Chat with other models
Comparison and alternatives
Browse all comparisons →Show all 24 popular comparisonssorted by 7-day search impressions
Large-scale open-source AI for social technologies.
Cheapest of 7 routes · Fireworks AI