Using Llama 3.1 8B Instruct on GroqCloud

Implementation guide · Llama 3.1 · AI at Meta

ServerlessOpen Weights

GroqCloud exposes Llama 3.1 8B Instruct through model ID llama-3.1-8b-instant. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-09. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at GroqCloud and generate an API key.
  2. 2
    Use the GroqCloud SDK or REST API to call llama-3.1-8b-instant — see the documentation for request format.
  3. 3
    You'll be billed $0.05/1M input, $0.08/1M output tokens. See full pricing.

Code Examples

See GroqCloud documentation for integration details.

Pricing on GroqCloud

TypePrice (per 1M)
Input tokens$0.05
Output tokens$0.08

Capabilities

Structured Outputs

About Llama 3.1 8B Instruct

The Llama 3.1 8B Instruct model, released on July 23, 2024, is a multilingual large language model with 8 billion parameters, optimized for instruction-following tasks. It features an enhanced transformer architecture, supporting languages like English, German, French, and others. The model excels in dialogue applications, having been fine-tuned using supervised fine-tuning and reinforcement learning with human feedback. Trained on approximately 15 trillion tokens with a December 2023 data cutoff, it outperforms many existing open-source and closed chat models in various benchmarks.

Model Specs

Released2024-07-23
Parameters8B
Context128k
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

GroqCloud

Groq

Mountain View, California, United States