LLM ReferenceLLM Reference
NVIDIA NIM

Llama 3.2 1B Instruct on NVIDIA NIM

Llama 3.2 · AI at Meta

ServerlessOpen Source

Last refreshed 2026-05-01. Next refresh: weekly.

Why use Llama 3.2 1B Instruct on NVIDIA NIM?

NVIDIA NIM offers Llama 3.2 1B Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare Llama 3.2 1B Instruct across 5 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: meta/llama-3.2-1b-instruct
Model ID
meta/llama-3.2-1b-instruct

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID meta/llama-3.2-1b-instruct.

Gotchas

  • Use provider model ID "meta/llama-3.2-1b-instruct", not the LLMReference slug "llama-3.2-1b-instruct".

Compare Llama 3.2 1B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
OpenRouter$0.03$0.20
Fireworks AI$0.10$0.10
NVIDIA NIM
Bitdeer AI$0.15$0.45
AWS Bedrock$0.10$0.10

Pricing

TypeRate
GPU Hour Rate$1.00/GPU·hr
GPU Config1xH100

Capabilities

Structured Outputs

About Llama 3.2 1B Instruct

Llama 3.2 1B Instruct available on AWS Bedrock

FAQ

What is the context window for Llama 3.2 1B Instruct on NVIDIA NIM?

Llama 3.2 1B Instruct supports a 128,000 token context window on NVIDIA NIM.

How does NVIDIA NIM compare to other Llama 3.2 1B Instruct providers?

Llama 3.2 1B Instruct is available from 5 providers. The cheapest input pricing is $0.027/1M tokens from OpenRouter.

What API model ID do I use for Llama 3.2 1B Instruct on NVIDIA NIM?

Use the model ID meta/llama-3.2-1b-instruct when calling NVIDIA NIM's API.

Who created Llama 3.2 1B Instruct?

Llama 3.2 1B Instruct was created by AI at Meta as part of the Llama 3.2 model family.

Is Llama 3.2 1B Instruct open source?

Llama 3.2 1B Instruct is open source according to the seed data.

Get Started

Model Specs

Released2024-09-25
Parameters1.23B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12