Llama 2 70B Chat
Llama 2 70B Chat is a legacy integration reference; keep it only while you identify a current replacement.
Use it for
- Teams maintaining an existing integration
- Workloads that can use a 4k context window
- Buyers comparing 4 tracked provider routes
Do not use it for
- New production launches
- Vision or document-understanding workloads
- Family
- Llama 2
- Released
- 2023-07-18
- Context
- 4k
- Parameters
- 70B
- Architecture
- Decoder Only
- Specialization
- general
- Training
- finetuned
Large-scale open-source AI for social technologies.
Cheapest of 14 routes · Lepton AI API
About
Llama 2 70B Chat is a large-scale language model with 70 billion parameters, designed for conversational AI applications. Released on July 18, 2023, it's part of Meta's Llama 2 family, featuring advanced transformer architecture optimized through supervised fine-tuning and reinforcement learning with human feedback. The model excels in generating human-like responses, outperforming many open-source alternatives and rivaling closed-source models like ChatGPT. Trained on 2 trillion tokens from diverse public sources, it's suitable for commercial and research applications in English, particularly for assistant-like functionalities. The model is available on Hugging Face for further exploration and implementation .
Llama 2 70B Chat is an open-source model in the Llama 2 family. The structured metadata tracks a 4k-token context window and structured outputs. This page tracks provider routes through Databricks Foundation Model Serving, Microsoft Foundry, GCP Vertex AI, and 11 more, with the cheapest tracked route listed at $0.5 input and $0.5 output per 1M tokens. Headline tracked benchmarks include Massive Multitask Language Understanding 68.9.
Top use-case fit
Classification
1 relevant benchmark in the decision map.
JSON / Tool use
Included by capability and metadata signals in the decision map.
Provider price ladder
Compare all 14Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Lepton AI API | $0.500 | $0.500 | Serverless |
| DeepInfra | $0.640 | $0.640 | Serverless |
| Fireworks AI | $0.900 | $0.900 | Serverless |
| Together AI | $0.900 | $0.900 | Serverless |
Capabilities
Benchmark peer barsfor Classification
Benchmark scores(1)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Massive Multitask Language Understanding | 68.9 | 5-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
Migration checks
No linked migration route is available for this model yet.