Last refreshed 2026-05-19. Next refresh: weekly.
Why use Qwen2-7B-Instruct on NVIDIA NIM?
NVIDIA NIM offers Qwen2-7B-Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: qwen/qwen2-7b-instructModel ID
qwen/qwen2-7b-instructRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
qwen/qwen2-7b-instruct.Gotchas
- Use provider model ID "qwen/qwen2-7b-instruct", not the LLMReference slug "qwen2-7b-instruct".
Capabilities
No model capability flags are currently sourced.
About Qwen2-7B-Instruct
Qwen2-7B-Instruct is Alibaba's Qwen2 model. It offers a 128K-token context window and scores 57.8 on Instruction-Following Evaluation.
Model Specs
Released2024-06-07
Parameters7B
Context128k
ArchitectureDecoder Only