Last refreshed 2026-05-01. Next refresh: weekly.
Why use Llama 3.2 3B Instruct on NVIDIA NIM?
NVIDIA NIM offers Llama 3.2 3B Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Llama 3.2 3B Instruct across 4 providers to find the best fit for your use caseInput / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: meta/llama-3.2-3b-instructModel ID
meta/llama-3.2-3b-instructRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
meta/llama-3.2-3b-instruct.Gotchas
- Use provider model ID "meta/llama-3.2-3b-instruct", not the LLMReference slug "llama-3.2-3b-instruct".
Compare Llama 3.2 3B Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| OpenRouter | $0.05 | $0.34 |
| Fireworks AI | $0.10 | $0.10 |
| NVIDIA NIM | — | — |
| AWS Bedrock | $0.15 | $0.15 |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
Structured Outputs
About Llama 3.2 3B Instruct
Llama 3.2 3B Instruct available on AWS Bedrock
FAQ
What is the context window for Llama 3.2 3B Instruct on NVIDIA NIM?
Llama 3.2 3B Instruct supports a 128,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Llama 3.2 3B Instruct providers?
Llama 3.2 3B Instruct is available from 4 providers. The cheapest input pricing is $0.051/1M tokens from OpenRouter.
What API model ID do I use for Llama 3.2 3B Instruct on NVIDIA NIM?
Use the model ID meta/llama-3.2-3b-instruct when calling NVIDIA NIM's API.
Who created Llama 3.2 3B Instruct?
Llama 3.2 3B Instruct was created by AI at Meta as part of the Llama 3.2 model family.
Is Llama 3.2 3B Instruct open source?
Llama 3.2 3B Instruct is open source according to the seed data.
Model Specs
Released2024-09-25
Parameters3.21B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12