Using Llama 3.1 8B Instruct on Cloudflare Workers AI

Implementation guide · Llama 3.1 · AI at Meta

ServerlessOpen Weights

Cloudflare Workers AI exposes Llama 3.1 8B Instruct through model ID @cf/meta/llama-3.1-8b-instruct-fp8. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-10-12. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Cloudflare Workers AI and generate an API key.
  2. 2
    Use the Cloudflare Workers AI SDK or REST API to call @cf/meta/llama-3.1-8b-instruct-fp8 — see the documentation for request format.
  3. 3
    You'll be billed $0.15/1M input, $0.29/1M output tokens. See full pricing.

Code Examples

See Cloudflare Workers AI documentation for integration details.

Pricing on Cloudflare Workers AI

TypePrice (per 1M)
Input tokens$0.15
Output tokens$0.29

Capabilities

Structured Outputs

About Llama 3.1 8B Instruct

The Llama 3.1 8B Instruct model, released on July 23, 2024, is a multilingual large language model with 8 billion parameters, optimized for instruction-following tasks. It features an enhanced transformer architecture, supporting languages like English, German, French, and others. The model excels in dialogue applications, having been fine-tuned using supervised fine-tuning and reinforcement learning with human feedback. Trained on approximately 15 trillion tokens with a December 2023 data cutoff, it outperforms many existing open-source and closed chat models in various benchmarks.

Model Specs

Released2024-07-23
Parameters8B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

Cloudflare Workers AI

Cloudflare

San Francisco, California, United States