Last refreshed 2026-05-01. Next refresh: weekly.
Why use Qwen2-7B-Instruct on NVIDIA NIM?
NVIDIA NIM offers Qwen2-7B-Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: qwen/qwen2-7b-instructModel ID
qwen/qwen2-7b-instructRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
qwen/qwen2-7b-instruct.Gotchas
- Use provider model ID "qwen/qwen2-7b-instruct", not the LLMReference slug "qwen2-7b-instruct".
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
About Qwen2-7B-Instruct
Instruction-tuned variant of Qwen2 7B from Alibaba Cloud.
FAQ
What is the context window for Qwen2-7B-Instruct on NVIDIA NIM?
Qwen2-7B-Instruct supports a 128,000 token context window on NVIDIA NIM.
What API model ID do I use for Qwen2-7B-Instruct on NVIDIA NIM?
Use the model ID qwen/qwen2-7b-instruct when calling NVIDIA NIM's API.
Who created Qwen2-7B-Instruct?
Qwen2-7B-Instruct was created by Alibaba as part of the Qwen2 model family.
Is Qwen2-7B-Instruct open source?
Qwen2-7B-Instruct is open source according to the seed data.
Model Specs
Released2024-06-07
Parameters7B
Context128K
ArchitectureDecoder Only