Gemma 2 27B Instruct
gemma-2-27b-it
About
Gemma 2 27B Instruct is a cutting-edge large language model from Google, excelling in text generation, question answering, summarization, and reasoning tasks. It features a decoder-only transformer architecture, utilizing 27 billion parameters, and supports context length processing of up to 8,192 tokens. The model incorporates innovative mechanisms like Grouped Query Attention and Sliding Window Attention to enhance efficiency and effectiveness in handling long texts. Its instruction-tuned variants are designed for improved interaction in conversational tasks, and it benefits from knowledge distillation techniques for enhanced performance. Additionally, Gemma 2 27B Instruct is openly accessible, promoting wider innovation in AI applications.
Gemma 2 27B Instruct has a 8K-token context window.
Gemma 2 27B Instruct input tokens at $0.25/1M, output at $0.75/1M.
Capabilities
Providers(5)
Compare all →| Provider | Input (per 1M) | Output (per 1M) | Type | |
|---|---|---|---|---|
| NVIDIA NIM | — | — | Provisioned | |
| OpenRouter | $0.65 | $0.65 | Serverless | |
| Fireworks AI | $0.9 | $0.9 | Serverless | |
| Arcee AI | $0.25 | $0.75 | Serverless | |
| Replicate API | $0.4 | $0.4 | Serverless |
Benchmark Scores(1)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Massive Multitask Language Understanding | 82.3 | 5-shot | Open LLM Leaderboard |
