Granite 3.1 8B Instruct
Granite 3.1 8B Instruct is a released long context model with open-source and 128k context; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating long context
- Workloads that can use a 128k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- Granite 3
- Released
- 2024-12-18
- Context
- 128k
- Parameters
- 8B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2024-04
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Available
- Code
- Unknown
No tracked provider token pricing is available yet.
About
IBM Granite 3.1 8B Instruct is a significant update to Granite 3.0 8B with extended 128K context window (up from 4K in Granite 3.0). Dense decoder-only transformer with 40 layers, 4096 embedding, GQA (32 heads, 8 KV heads), RoPE. Supports 12 languages, code, tool-calling, RAG, and long-context document tasks. Open LLM Leaderboard avg 71.31. MMLU 65.34, GSM8K 73.84. Apache 2.0.
Granite 3.1 8B Instruct is an open-source model in the Granite 3 family. The structured metadata tracks a 128k-token context window. No headline benchmark score is tracked for Granite 3.1 8B Instruct yet.
Top use-case fit
Long context
Included by capability and metadata signals in the decision map.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Long context
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Compare Granite 3.1 8B Instruct with other models
Frequently asked questions
What is the context window of Granite 3.1 8B Instruct?
Granite 3.1 8B Instruct has a context window of 128k tokens.
When was Granite 3.1 8B Instruct released?
Granite 3.1 8B Instruct was released on 2024-12-18.
No tracked provider token pricing is available yet.