LLM ReferenceLLM Reference

Together Llama 2

1 model2023Up to 32K ctxFrom $0.2/1M input

About

The Together Llama 2 family of large language models extends the capabilities of Meta's Llama 2, maintaining its open-source nature and being available for research and commercial purposes 14. These models feature a noteworthy advancement in context length, allowing for 32K tokens compared to Llama 2's initial 4K, enabling more complex tasks like multi-document question answering and long-form text summarization 45. Among the family's innovations is the Llama-2-7B-32K-Instruct, tailored through high-quality instruction and conversational data for improved performance in dialogue-based interactions 15. Efficiency in training and inference is enhanced through optimizations such as FlashAttention-2, helping the models operate faster and more resource-efficiently 4. By providing training recipes and datasets, Together AI supports broader community engagement and progression in the open-source LLM domain 5.

Specifications(1 models)

Together Llama 2 model specifications comparison
ModelReleasedContextParametersStructured Outputs
Llama 2 7B 32K2023-0732K7BYes

Available From(1 provider)

Pricing

Together Llama 2 model pricing by provider
ModelProviderInput / 1MOutput / 1MType
Llama 2 7B 32KTogether AI$0.2$0.2Serverless

Frequently Asked Questions

What is Together Llama 2?
The Together Llama 2 family of large language models extends the capabilities of Meta's Llama 2, maintaining its open-source nature and being available for research and commercial purposes 14. These models feature a noteworthy advancement in context length, allowing for 32K tokens compared to Llama 2's initial 4K, enabling more complex tasks like multi-document question answering and long-form text summarization 45. Among the family's innovations is the Llama-2-7B-32K-Instruct, tailored through high-quality instruction and conversational data for improved performance in dialogue-based interactions 15. Efficiency in training and inference is enhanced through optimizations such as FlashAttention-2, helping the models operate faster and more resource-efficiently 4. By providing training recipes and datasets, Together AI supports broader community engagement and progression in the open-source LLM domain 5.
How many models are in the Together Llama 2 family?
The Together Llama 2 family contains 1 model.
What is the latest Together Llama 2 model?
The latest model is Llama 2 7B 32K, released in 2023-07.
How much does Together Llama 2 cost?
Together Llama 2 models are available at $0.2/1M input tokens through providers like Together AI.

Models(1)