Granite
About
The Granite family of large language models, developed by IBM, is tailored for enterprise applications. These open-source models are available under the Apache 2.0 license and highlight performance, safety, and cost-efficiency. The latest iteration, Granite 3.0, marks a significant upgrade, being trained on over 12 trillion tokens in 12 languages and 116 programming languages. Offering a variety of model sizes and specializations, including the safety-focused Granite Guardian and latency-optimized Mixture-of-Experts (MoE) models, they brim with versatility. These models can handle tasks such as summarization, text classification, and code generation. They're accessible across platforms like Hugging Face, IBM watsonx, and Google Cloud's Vertex AI. IBM ensures transparency and responsible AI utilization through comprehensive documentation and benchmarks, underscoring their commitment to open-source innovation 123.
Specifications(10 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Granite 3B | 2024-10 | — | 3B |
| Granite 7B | 2024-10 | — | 7B |
| Granite 34B | 2024-10 | — | 34B |
| Granite 13B Chat | 2023-11 | 8K | 13B |
| Granite 20B Multilingual | 2023-11 | 8K | 20B |
| Granite 8B Japanese | 2023-11 | 4K | 8B |
| Granite 13B | 2023-11 | 8K | 13B |
| Granite 7B Lab | 2023-11 | 8K | 7B |
| IBM Granite 13B Instruct v1 | 2023-11 | 8K | 13B |
| IBM Granite 13B Chat v1 | 2023-11 | 8K | 13B |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| IBM Granite 13B Instruct v1 | IBM watsonx | $0.185 | $0.185 | Serverless |
| IBM Granite 13B Chat v1 | IBM watsonx | $0.185 | $0.185 | Serverless |
| Granite 20B Multilingual | IBM watsonx | $0.6 | $0.6 | Serverless |
| Granite 13B Chat | IBM watsonx | $0.6 | $0.6 | Serverless |
| Granite 13B | IBM watsonx | $0.6 | $0.6 | Serverless |
| Granite 8B Japanese | IBM watsonx | $0.6 | $0.6 | Serverless |
| Granite 7B Lab | IBM watsonx | $0.6 | $0.6 | Serverless |
Frequently Asked Questions
- What is Granite?
- The Granite family of large language models, developed by IBM, is tailored for enterprise applications. These open-source models are available under the Apache 2.0 license and highlight performance, safety, and cost-efficiency. The latest iteration, Granite 3.0, marks a significant upgrade, being trained on over 12 trillion tokens in 12 languages and 116 programming languages. Offering a variety of model sizes and specializations, including the safety-focused Granite Guardian and latency-optimized Mixture-of-Experts (MoE) models, they brim with versatility. These models can handle tasks such as summarization, text classification, and code generation. They're accessible across platforms like Hugging Face, IBM watsonx, and Google Cloud's Vertex AI. IBM ensures transparency and responsible AI utilization through comprehensive documentation and benchmarks, underscoring their commitment to open-source innovation 123.
- How many models are in the Granite family?
- The Granite family contains 10 models.
- What is the latest Granite model?
- The latest model is Granite 3B, released in 2024-10.
- How much does Granite cost?
- Granite models range from $0.185/1M to $0.6/1M input tokens depending on the model and provider.
Related Model Families
Models(10)
Granite 3B
Granite 7B
Granite 34B
Granite 13B Chat
Granite 20B Multilingual
Granite 8B Japanese
Granite 13B
Granite 7B Lab
IBM Granite 13B Instruct v1
IBM Granite 13B Chat v1