LLM Reference

Gemma 2 27B Instruct

About

Gemma 2 27B Instruct is a cutting-edge large language model from Google, excelling in text generation, question answering, summarization, and reasoning tasks. It features a decoder-only transformer architecture, utilizing 27 billion parameters, and supports context length processing of up to 8,192 tokens. The model incorporates innovative mechanisms like Grouped Query Attention and Sliding Window Attention to enhance efficiency and effectiveness in handling long texts. Its instruction-tuned variants are designed for improved interaction in conversational tasks, and it benefits from knowledge distillation techniques for enhanced performance. Additionally, Gemma 2 27B Instruct is openly accessible, promoting wider innovation in AI applications.

Capabilities

MultimodalFunction CallingTool UseJSON Mode

Providers(1)

ProviderInput (per 1M)Output (per 1M)Type
NVIDIA NIMProvisioned

Benchmark Scores(1)

BenchmarkScoreVersionSource
Massive Multitask Language Understanding82.35-shotOpen LLM Leaderboard

Specifications

FamilyGemma 2
Released2024-06-27
Parameters27B
Context8K
ArchitectureDecoder Only
Specializationgeneral