What is the context window of Llama 2 7B 32K?

Llama 2 7B 32K has a context window of 32K tokens.

How much does Llama 2 7B 32K cost?

Llama 2 7B 32K is available at $0.2/1M input tokens through Together AI.

When was Llama 2 7B 32K released?

Llama 2 7B 32K was released on 2023-07-18.

Which providers offer Llama 2 7B 32K?

Llama 2 7B 32K is available from 1 provider: Together AI.

Llama 2 7B 32K

Name: Llama 2 7B 32K
Author: Together.ai

Open Source

About

LLaMA-2-7B-32K is an open-source language model engineered by Together, derived from Meta's LLaMA-2 7B. It boasts a unique extended context length of up to 32,000 tokens, which enhances its ability to tackle tasks involving long-range context, such as multi-document question answering and lengthy text summarization. The model integrates optimizations, including FlashAttention-2, to boost inference and training efficiency. It combines pre-training with instruction tuning data for improved task performance and offers fine-tuning examples for specialized applications, like book summarization or multi-document Q&A. This model marks a substantial progress in the domain of large language models, serving as a potent tool for natural language processing tasks 1311.