Llama 3.1 8B Instruct on FlexAI

Llama 3.1 · AI at Meta

Serverless
Open Weights

Last refreshed 2026-11-18. Next refresh: weekly.

Why use Llama 3.1 8B Instruct on FlexAI?

FlexAI offers Llama 3.1 8B Instruct with pay-as-you-go pricing at $0.05/1M input tokens. FlexAI operates Token Factory, an OpenAI-compatible inference API for open models, plus dedicated GPU endpoints, fine-tuning, training, and private-cloud AI Factory deployments.

Compare Llama 3.1 8B Instruct across 18 providers to find the best fit for your use case
Input / 1M
$0.050
Output / 1M
$0.080
Cache
read $0.0075
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: Meta-Llama-3.1-8B-Instruct-FP8
Model ID
Meta-Llama-3.1-8B-Instruct-FP8

Request example

Curated snippets for this provider are not sourced yet. Use FlexAI documentation with model ID Meta-Llama-3.1-8B-Instruct-FP8.

Gotchas

  • Use provider model ID "Meta-Llama-3.1-8B-Instruct-FP8", not the LLMReference slug "llama3.1-8b-instruct".

Compare Llama 3.1 8B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
Cloudflare Workers AI$0.15$0.29
OctoAI API (Deprecated)——
Together AI$0.18$0.18
Fireworks AI$0.20$0.20
NVIDIA NIM——
View all 18 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.05
Output tokens$0.08

Capabilities

Structured Outputs

About Llama 3.1 8B Instruct

The Llama 3.1 8B Instruct model, released on July 23, 2024, is a multilingual large language model with 8 billion parameters, optimized for instruction-following tasks. It features an enhanced transformer architecture, supporting languages like English, German, French, and others. The model excels in dialogue applications, having been fine-tuned using supervised fine-tuning and reinforcement learning with human feedback. Trained on approximately 15 trillion tokens with a December 2023 data cutoff, it outperforms many existing open-source and closed chat models in various benchmarks.

Get Started

Model Specs

Released2024-07-23
Parameters8B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

FlexAI

FlexAI Systems Inc

All models on FlexAI →