Llama 2 7B 32K
- Family
- Together Llama 2
- Released
- 2023-07-18
- Context
- 32K
- Parameters
- 7B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2022-09
- Specialization
- general
- Openness
- Open weights
- License
- Llama 2 CommunityRestricted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Blazing-fast, cost-effective AI inference solutions
No tracked provider pricing is available yet.
About
LLaMA-2-7B-32K is an open-source language model engineered by Together, derived from Meta's LLaMA-2 7B. It boasts a unique extended context length of up to 32,000 tokens, which enhances its ability to tackle tasks involving long-range context, such as multi-document question answering and lengthy text summarization. The model integrates optimizations, including FlashAttention-2, to boost inference and training efficiency. It combines pre-training with instruction tuning data for improved task performance and offers fine-tuning examples for specialized applications, like book summarization or multi-document Q&A.
Providers
No active provider routes are tracked for this model yet.
Deprecated provider routes(1)
| Provider | Status | Catalog ID |
|---|---|---|
| Together AI | Deprecated | — |
Available via routers & gateways(1)
Capabilities
Benchmark peer barsfor Classification
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Blazing-fast, cost-effective AI inference solutions
No tracked provider pricing is available yet.