What is the context window of Granite 3.1 3B A800M Instruct?

Granite 3.1 3B A800M Instruct has a context window of 128K tokens.

When was Granite 3.1 3B A800M Instruct released?

Granite 3.1 3B A800M Instruct was released on 2024-12-18.

Granite 3.1 3B A800M Instruct

Name: Granite 3.1 3B A800M Instruct
Author: IBM Research

granite-3.1-3b-a800m-instruct

Open Source

About

IBM Granite 3.1 3B A800M Instruct is a MoE long-context model in the Granite 3.1 family with 3B total parameters and 800M active parameters. Designed for low-latency enterprise applications. Features 128K context window. Apache 2.0.

Granite 3.1 3B A800M Instruct has a 128K-token context window.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Rankings

Best Open Source LLMs Cheapest LLM APIs Best LLM APIs Best Free LLMs Best LLMs for Writing Best LLMs for Marketing

Specifications

FamilyGranite 3

Released2024-12-18

Parameters3B total / 800M active

Context128K

ArchitectureMixture-of-Experts (MoE) decoder-only transformer

Created by

IBM Research

Creating reliable and adaptable AI solutions

Armonk, New York, United States

Founded 1945

Website