Last refreshed 2026-05-01. Next refresh: weekly.
Why use Granite Guardian 3.0 8B on NVIDIA NIM?
NVIDIA NIM offers Granite Guardian 3.0 8B with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: ibm/granite-guardian-3.0-8bModel ID
ibm/granite-guardian-3.0-8bRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
ibm/granite-guardian-3.0-8b.Gotchas
- Use provider model ID "ibm/granite-guardian-3.0-8b", not the LLMReference slug "granite-guardian-3.0-8b".
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
About Granite Guardian 3.0 8B
IBM Granite Guardian safety model for content moderation and risk assessment.
FAQ
What is the context window for Granite Guardian 3.0 8B on NVIDIA NIM?
Granite Guardian 3.0 8B supports a 8,000 token context window on NVIDIA NIM.
What API model ID do I use for Granite Guardian 3.0 8B on NVIDIA NIM?
Use the model ID ibm/granite-guardian-3.0-8b when calling NVIDIA NIM's API.
Who created Granite Guardian 3.0 8B?
Granite Guardian 3.0 8B was created by IBM Research as part of the Granite 3 model family.
Is Granite Guardian 3.0 8B open source?
Granite Guardian 3.0 8B is open source according to the seed data.
Model Specs
Released2025-03-01
Parameters8B
Context8K
ArchitectureDecoder Only