LLM ReferenceLLM Reference

Llama 2

AI at MetaLlama 2 CommunityOpen SourceHighlight
14 models2023Up to 4K ctxFrom $0.05/1M input

About

Llama 2, developed by Meta AI and released in July 2023, is a prominent family of large language models designed as an open-source alternative to proprietary chatbots. Its models, available in multiple sizes from 7 billion to 70 billion parameters, provide varying levels of accuracy balanced with computational efficiency. Llama 2 supports both research and commercial use, fostering greater accessibility and innovation in the AI community. Emphasizing safety and usefulness, the model employs techniques like reinforcement learning from human feedback (RLHF) and features specialized Llama 2-Chat models optimized for conversational applications. This makes it a versatile tool for various AI-driven tasks 1 2 3.

Specifications(14 models)

Llama 2 model specifications comparison
ModelReleasedContextParametersStructured Outputs
Llama 2 13B Chat2023-074K13BYes
Llama 2 7B Chat2023-074K7BYes
Llama 2 70B2023-074K70BNo
Llama 2 13B2023-074K13BNo
Llama 2 7B2023-074K7BNo
Llama 2 34B (Unreleased)2023-0734BNo
Together AI Llama-2-7B-chat2023-074K7BYes
Together AI Llama-2-13B-chat2023-074K13BYes
Together AI Llama-2-70B-chat2023-074K70BYes
OctoML Llama-2-70b-chat2023-074K70BNo
Meta Llama 2 Chat 70B2023-074K70BYes
Llama 2 70B Chat on IBM Watsonx2023-074K70BNo
Vultr Llama 2 70B2023-074K70BNo

Available From(17 providers)

Pricing

Llama 2 model pricing by provider
ModelProviderInput / 1MOutput / 1MType
Llama 2 7B ChatReplicate API$0.05$0.25Serverless
Llama 2 7B ChatDeepInfra$0.07$0.07Serverless
Llama 2 7B ChatLepton AI API$0.07$0.07Serverless
Together AI Llama-2-7B-chatTogether AI$0.1$0.1Serverless
Llama 2 13B ChatReplicate API$0.1$0.5Serverless
Llama 2 13B ChatDeepInfra$0.13$0.13Serverless
Llama 2 13B ChatLepton AI API$0.13$0.13Serverless
Together AI Llama-2-13B-chatTogether AI$0.15$0.15Serverless
Llama 2 70B Chat on IBM WatsonxIBM watsonx$0.185$0.185Serverless
Llama 2 7B ChatFireworks AI$0.2$0.2Provisioned
Llama 2 7B ChatTogether AI$0.2$0.2Serverless
Llama 2 13BFireworks AI$0.2$0.2Serverless
Llama 2 13B ChatFireworks AI$0.2$0.2Serverless
Llama 2 7BFireworks AI$0.2$0.2Serverless
Llama 2 13B ChatTogether AI$0.3$0.3Serverless
OctoML Llama-2-70b-chatOctoML$0.4$0.6Serverless
Together AI Llama-2-70B-chatTogether AI$0.5$0.6Serverless
Llama 2 7B ChatMicrosoft Foundry$0.52$0.67Serverless
Llama 2 13B ChatIBM watsonx$0.6$0.6Serverless
Llama 2 13B ChatAWS Bedrock$0.75$1Serverless
Llama 2 13B ChatMicrosoft Foundry$0.81$0.94Serverless
Llama 2 70BFireworks AI$0.9$0.9Serverless
Llama 2 13B ChatDatabricks Foundation Model Serving$0.95$0.95Serverless
Meta Llama 2 Chat 70BAWS Bedrock$2.1$2.8Serverless

Frequently Asked Questions

What is Llama 2?
Llama 2, developed by Meta AI and released in July 2023, is a prominent family of large language models designed as an open-source alternative to proprietary chatbots. Its models, available in multiple sizes from 7 billion to 70 billion parameters, provide varying levels of accuracy balanced with computational efficiency. Llama 2 supports both research and commercial use, fostering greater accessibility and innovation in the AI community. Emphasizing safety and usefulness, the model employs techniques like reinforcement learning from human feedback (RLHF) and features specialized Llama 2-Chat models optimized for conversational applications. This makes it a versatile tool for various AI-driven tasks 1 2 3.
How many models are in the Llama 2 family?
The Llama 2 family contains 14 models.
What is the latest Llama 2 model?
The latest model is Llama 2 70B Chat, released in 2023-07.
How much does Llama 2 cost?
Llama 2 models range from $0.05/1M to $2.1/1M input tokens depending on the model and provider.

Models(14)