Llama 3.1 Nemotron Nano 8B v1 on NVIDIA NIM

Name: Llama 3.1 Nemotron Nano 8B v1 on NVIDIA NIM
Brand: NVIDIA AI
SKU: llama-3.1-nemotron-nano-8b-v1-nvidia-nim

Serverless

Open Weights

Last refreshed 2026-09-22. Next refresh: weekly.

Why use Llama 3.1 Nemotron Nano 8B v1 on NVIDIA NIM?

NVIDIA NIM offers Llama 3.1 Nemotron Nano 8B v1. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Input / 1M

Output / 1M

Cache

Not sourced

Batch

Not sourced

Docs fallback

Install

Use the provider REST API or SDK

Auth

Create a provider API key

Call

model: nvidia/llama-3.1-nemotron-nano-8b-v1

Model ID

nvidia/llama-3.1-nemotron-nano-8b-v1

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID nvidia/llama-3.1-nemotron-nano-8b-v1.

Use provider model ID "nvidia/llama-3.1-nemotron-nano-8b-v1", not the LLMReference slug "llama-3.1-nemotron-nano-8b-v1".

No model capability flags are currently sourced.

NVIDIA Nemotron Nano 8B, a compact model derived from Llama 3.1 for edge deployment.

Released2025-03-01

Parameters8B

Context4K

ArchitectureDecoder Only

NVIDIA