Llama 3.1 Nemotron Nano 8B v1 on NVIDIA NIM

Nemotron Nano 2 · NVIDIA AI

ServerlessOpen Weights

Last refreshed 2026-09-22. Next refresh: weekly.

Why use Llama 3.1 Nemotron Nano 8B v1 on NVIDIA NIM?

NVIDIA NIM offers Llama 3.1 Nemotron Nano 8B v1 with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: nvidia/llama-3.1-nemotron-nano-8b-v1
Model ID
nvidia/llama-3.1-nemotron-nano-8b-v1

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID nvidia/llama-3.1-nemotron-nano-8b-v1.

Gotchas

  • Use provider model ID "nvidia/llama-3.1-nemotron-nano-8b-v1", not the LLMReference slug "llama-3.1-nemotron-nano-8b-v1".

Capabilities

No model capability flags are currently sourced.

About Llama 3.1 Nemotron Nano 8B v1

NVIDIA Nemotron Nano 8B, a compact model derived from Llama 3.1 for edge deployment.

Get Started

DocsPortalPricing

Model Specs

Released2025-03-01
Parameters8B
Context4k
ArchitectureDecoder Only

Related Models on NVIDIA NIM

Nemotron-Nano-12B-v2-VLNemotron-Nano-9B-v2Llama 3.1 Nemotron Nano VL 8B v1Llama 3.1 Nemotron Nano 4B v1.1

Provider

NVIDIA NIM

NVIDIA

All models on NVIDIA NIM →Provider setup guide →