LLM ReferenceLLM Reference

Granite Guardian

6 models2024–2026Up to 128K ctx

About

The Granite Guardian family of language models is engineered to identify and mitigate risks within user prompts and responses by serving as safety guardrails. These models, developed by IBM, are adept at pinpointing issues such as social bias, hate speech, toxicity, and other harmful content, as categorized in IBM's AI Risk Atlas. Additionally, they offer specific checks for concerns related to Retrieval Augmented Generation (RAG), such as groundedness and context relevance. Available in 8B and 2B parameter sizes, Granite Guardian models can be integrated with any open or proprietary language models to bolster AI safety and responsible use practices. Notably, in testing, the Granite Guardian 3.0 8B model surpassed Meta's LlamaGuard 3 8B by improving the average F1-score by 4 points on standard risk detection benchmarks 345.

Specifications(6 models)

Granite Guardian model specifications comparison
ModelReleasedContextParameters
Granite Guardian 4.1 8B2026-048K8B
Granite Guardian 3.3 8B2025-088B
Granite Guardian 3.2 5B2025-025B
Granite Guardian 3.1 8B2024-12128K8B
Granite Guardian 3.1 2B2024-12128K2B
Granite Guardian 3.0 2B2024-104K2B

Frequently Asked Questions

What is Granite Guardian?
The Granite Guardian family of language models is engineered to identify and mitigate risks within user prompts and responses by serving as safety guardrails. These models, developed by IBM, are adept at pinpointing issues such as social bias, hate speech, toxicity, and other harmful content, as categorized in IBM's AI Risk Atlas. Additionally, they offer specific checks for concerns related to Retrieval Augmented Generation (RAG), such as groundedness and context relevance. Available in 8B and 2B parameter sizes, Granite Guardian models can be integrated with any open or proprietary language models to bolster AI safety and responsible use practices. Notably, in testing, the Granite Guardian 3.0 8B model surpassed Meta's LlamaGuard 3 8B by improving the average F1-score by 4 points on standard risk detection benchmarks 345.
How many models are in the Granite Guardian family?
The Granite Guardian family contains 6 models.
What is the latest Granite Guardian model?
The latest model is Granite Guardian 4.1 8B, released in 2026-04.

Models(6)