Last refreshed 2026-05-01. Next refresh: weekly.
Why use Granite 34B Code on NVIDIA NIM?
NVIDIA NIM offers Granite 34B Code with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Granite 34B Code across 3 providers to find the best fit for your use caseInput / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: granite-34b-codeModel ID
granite-34b-codeRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
granite-34b-code.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Granite 34B Code Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| NVIDIA NIM | — | — |
| RHEL AI | — | — |
| IBM watsonx | $0.60 | $0.60 |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
FAQ
What is the context window for Granite 34B Code on NVIDIA NIM?
Granite 34B Code supports a 8,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Granite 34B Code providers?
Granite 34B Code is available from 3 providers. The cheapest input pricing is $0.6/1M tokens from IBM watsonx.
Who created Granite 34B Code?
Granite 34B Code was created by IBM Research as part of the Granite Code model family.
Is Granite 34B Code open source?
Granite 34B Code's open source status is unknown in the seed data.
Get Started
Model Specs
Released2024-05-06
Parameters34B
Context8K
ArchitectureDecoder Only