Using Llama 3.1 8B Instruct on NVIDIA NIM
Implementation guide · Llama 3.1 · AI at Meta
NVIDIA NIM exposes Llama 3.1 8B Instruct through model ID llama3.1-8b-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-07-09. Next refresh: weekly.
Quick Start
- 1
- 2Use the NVIDIA NIM SDK or REST API to call
llama3.1-8b-instruct— see the documentation for request format. - 3
Code Examples
Pricing on NVIDIA NIM
Capabilities
About Llama 3.1 8B Instruct
The Llama 3.1 8B Instruct model, released on July 23, 2024, is a multilingual large language model with 8 billion parameters, optimized for instruction-following tasks. It features an enhanced transformer architecture, supporting languages like English, German, French, and others. The model excels in dialogue applications, having been fine-tuned using supervised fine-tuning and reinforcement learning with human feedback. Trained on approximately 15 trillion tokens with a December 2023 data cutoff, it outperforms many existing open-source and closed chat models in various benchmarks.