Last refreshed 2026-05-01. Next refresh: weekly.
Why use Llama 3.2 NV RerankQA 1B v2 on NVIDIA NIM?
NVIDIA NIM offers Llama 3.2 NV RerankQA 1B v2 with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: nvidia/llama-3.2-nv-rerankqa-1b-v2Model ID
nvidia/llama-3.2-nv-rerankqa-1b-v2Request example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
nvidia/llama-3.2-nv-rerankqa-1b-v2.Gotchas
- Use provider model ID "nvidia/llama-3.2-nv-rerankqa-1b-v2", not the LLMReference slug "llama-3.2-nv-rerankqa-1b-v2".
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
About Llama 3.2 NV RerankQA 1B v2
NVIDIA reranking model for search result re-ranking, based on Llama 3.2.
FAQ
What is the context window for Llama 3.2 NV RerankQA 1B v2 on NVIDIA NIM?
Llama 3.2 NV RerankQA 1B v2 supports a 4,000 token context window on NVIDIA NIM.
What API model ID do I use for Llama 3.2 NV RerankQA 1B v2 on NVIDIA NIM?
Use the model ID nvidia/llama-3.2-nv-rerankqa-1b-v2 when calling NVIDIA NIM's API.
Who created Llama 3.2 NV RerankQA 1B v2?
Llama 3.2 NV RerankQA 1B v2 was created by NVIDIA AI as part of the NV-Embed model family.
Is Llama 3.2 NV RerankQA 1B v2 open source?
Llama 3.2 NV RerankQA 1B v2 is open source according to the seed data.
Model Specs
Released2025-03-01
Parameters1B
Context4K
Architectureencoder