Granite 3.1 8B Instruct
Granite 3.1 8B Instruct has model metadata, but missing tracked provider pricing keeps it from being a default production pick.
Use it for
- Teams evaluating long context
- Workloads that can use a 128k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- Granite 3
- Released
- 2024-12-18
- Context
- 128k
- Parameters
- 8B
- Architecture
- Dense decoder-only transformer: 40 layers, 4096 embed, GQA 32/8 heads, RoPE, SwiGLU
- Knowledge cutoff
- 2024-04
- Openness
- Open source
- License
- Apache 2.0(OSI)Commercial use allowed
No tracked provider token pricing is available yet.
About
IBM Granite 3.1 8B Instruct is a significant update to Granite 3.0 8B with extended 128K context window (up from 4K in Granite 3.0). Dense decoder-only transformer with 40 layers, 4096 embedding, GQA (32 heads, 8 KV heads), RoPE. Supports 12 languages, code, tool-calling, RAG, and long-context document tasks. Open LLM Leaderboard avg 71.31. MMLU 65.34, GSM8K 73.84. Apache 2.0.
Granite 3.1 8B Instruct is an open-source model in the Granite 3 family. The structured metadata tracks a 128k-token context window. No headline benchmark score is tracked for Granite 3.1 8B Instruct yet.
Top use-case fit
Long context
Included by capability and metadata signals in the decision map.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Long context
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider token pricing is available yet.