What is the context window of Llama 3 70B?

Llama 3 70B has a context window of 8K tokens.

How much does Llama 3 70B cost?

Llama 3 70B is available at $0.65/1M input tokens through Replicate API.

When was Llama 3 70B released?

Llama 3 70B was released on 2024-04-18.

Which providers offer Llama 3 70B?

Llama 3 70B is available from 1 provider: Replicate API.

What benchmarks has Llama 3 70B been tested on?

Llama 3 70B has been evaluated on 4 benchmarks, including Google-Proof Q&A, HellaSwag, HumanEval, Massive Multitask Language Understanding.

Llama 3 70B

Name: Llama 3 70B
Author: AI at Meta

llama3-70b

Open Source

About

The Llama 3 70B model is a state-of-the-art large language model with 70 billion parameters, released by Meta on April 18, 2024. It's based on an auto-regressive transformer architecture and has been optimized for dialogue applications using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF). The model supports an 8,000-token context length and has been trained on over 15 trillion tokens from public online sources. It excels in tasks such as conversational AI, text generation, and natural language understanding, outperforming many existing open-source chat models on industry benchmarks. The model is designed with a focus on safety and helpfulness, making it suitable for both commercial and research applications, particularly in English. For more details, visit the Hugging Face link .

Llama 3 70B has a 8K-token context window.

Llama 3 70B input tokens at $0.65/1M, output at $2.75/1M.