Llama 2 13B Chat
Llama 2 13B Chat is worth evaluating for coding, classification, and json / tool use when its provider route and context window match the workload.
Use it for
- Teams evaluating coding, classification, and json / tool use
- Workloads that can use a 4k context window
- Buyers comparing 4 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Family
- Llama 2
- Released
- 2023-07-18
- Context
- 4k
- Parameters
- 13B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2022-09
- Specialization
- general
- Training
- finetuned
Large-scale open-source AI for social technologies.
Cheapest of 11 routes · DeepInfra
About
The Llama 2 13B Chat model is a 13 billion parameter generative text model developed by Meta, optimized for conversational applications. Released on July 18, 2023, it's part of the Llama 2 family and excels in dialogue scenarios. The model leverages supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to generate coherent and contextually relevant responses. Trained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and matches popular closed-source models in helpfulness and safety. This model is ideal for AI engineers working on chatbots, virtual assistants, and customer service automation. For more details, visit the model's Hugging Face page [1].
Llama 2 13B Chat is an open-source model in the Llama 2 family. The structured metadata tracks a 4k-token context window and structured outputs. This page tracks provider routes through Alibaba Cloud PAI-EAS, AWS Bedrock, Microsoft Foundry, and 8 more, with the cheapest tracked route listed at $0.1 input and $0.5 output per 1M tokens. Headline tracked benchmarks include Google-Proof Q&A 41.8, HellaSwag 88.5, and HumanEval 59.3.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ A1 relevant benchmark in the decision map.
Classification
Q/$ A2 relevant benchmarks in the decision map.
JSON / Tool use
Included by capability and metadata signals in the decision map.
Provider price ladder
Compare all 11Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| DeepInfra | $0.130 | $0.130 | Serverless |
| Lepton AI API | $0.130 | $0.130 | Serverless |
| Fireworks AI | $0.200 | $0.200 | Serverless |
| Together AI | $0.300 | $0.300 | Serverless |
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(4)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Google-Proof Q&A | 41.8 | diamond | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| HellaSwag | 88.5 | 10-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| HumanEval | 59.3 | pass@1 | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| Massive Multitask Language Understanding | 71.2 | 5-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
Migration checks
No linked migration route is available for this model yet.