Llama 3.1 70B Instruct on NVIDIA NIM
Llama 3.1 · AI at Meta
Last refreshed 2026-10-17. Next refresh: weekly.
Why use Llama 3.1 70B Instruct on NVIDIA NIM?
NVIDIA NIM offers Llama 3.1 70B Instruct. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Llama 3.1 70B Instruct across 14 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: meta/llama-3.1-70b-instructmeta/llama-3.1-70b-instructRequest example
meta/llama-3.1-70b-instruct.Gotchas
- Use provider model ID "meta/llama-3.1-70b-instruct", not the LLMReference slug "llama3.1-70b-instruct".
Compare Llama 3.1 70B Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Cloudflare Workers AI | — | — |
| OctoAI API (Deprecated) | — | — |
| Together AI | $0.88 | $0.88 |
| Fireworks AI | $0.90 | $0.90 |
| NVIDIA NIM | — | — |
Capabilities
About Llama 3.1 70B Instruct
The Llama 3.1 70B Instruct model is a cutting-edge large language model with 70 billion parameters, designed for instruction-following tasks. It features multilingual capabilities, supporting languages like English, German, French, and others. Fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), it excels in understanding and responding to user instructions. The model can handle a context length of up to 128k tokens, making it suitable for complex dialogue systems and applications requiring detailed responses.