LLM ReferenceLLM Reference

Granite 3.1 8B Instruct

granite-3.1-8b-instruct

Open Source

About

IBM Granite 3.1 8B Instruct is a significant update to Granite 3.0 8B with extended 128K context window (up from 4K in Granite 3.0). Dense decoder-only transformer with 40 layers, 4096 embedding, GQA (32 heads, 8 KV heads), RoPE. Supports 12 languages, code, tool-calling, RAG, and long-context document tasks. Open LLM Leaderboard avg 71.31. MMLU 65.34, GSM8K 73.84. Apache 2.0.

Granite 3.1 8B Instruct has a 128K-token context window.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Rankings

Best Open Source LLMsBest Small Language Models (SLMs)Cheapest LLM APIsBest LLM APIsBest Free LLMsBest LLMs for WritingBest LLMs for Marketing

Specifications

FamilyGranite 3
Released2024-12-18
Parameters8B
Context128K
ArchitectureDense decoder-only transformer: 40 layers, 4096 embed, GQA 32/8 heads, RoPE, SwiGLU

Created by

IBM ResearchIBM Research

Creating reliable and adaptable AI solutions

Armonk, New York, United States
Founded 1945
Website