Llama 3.2 NV RerankQA 1B v2 on NVIDIA NIM

NV-Embed · NVIDIA AI

Serverless
Open Weights

Last refreshed 2026-05-19. Next refresh: weekly.

Why use Llama 3.2 NV RerankQA 1B v2 on NVIDIA NIM?

NVIDIA NIM offers Llama 3.2 NV RerankQA 1B v2. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: nvidia/llama-3.2-nv-rerankqa-1b-v2
Model ID
nvidia/llama-3.2-nv-rerankqa-1b-v2

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID nvidia/llama-3.2-nv-rerankqa-1b-v2.

Gotchas

  • Use provider model ID "nvidia/llama-3.2-nv-rerankqa-1b-v2", not the LLMReference slug "llama-3.2-nv-rerankqa-1b-v2".

Capabilities

No model capability flags are currently sourced.

About Llama 3.2 NV RerankQA 1B v2

Llama 3.2 NV RerankQA 1B v2 is NVIDIA AI's NV-Embed model focused on search ranking and reranking. It was released 2025-03-01.

Get Started

Model Specs

Released2025-03-01
Parameters1B
Context4K
ArchitectureEncoder Only