LLM Reference

Using Gemma 2 27B Instruct on Arcee AI

Implementation guide · Gemma 2 · Google DeepMind

ServerlessOpen Source

Quick Start

  1. 1
    Create an account at Arcee AI and generate an API key.
  2. 2
    Use the Arcee AI SDK or REST API to call gemma-2-27b-it.
  3. 3
    You'll be billed $0.25/1M input, $0.75/1M output tokens.

Code Examples

Code examples for this provider have not been sourced yet.

About Arcee AI

Arcee AI is a custom model fine-tuning and inference API platform specializing in efficient, domain-adapted language models.

Pricing on Arcee AI

TypePrice (per 1M)
Input tokens$0.25
Output tokens$0.75

Capabilities

Structured Outputs

About Gemma 2 27B Instruct

Gemma 2 27B Instruct is a cutting-edge large language model from Google, excelling in text generation, question answering, summarization, and reasoning tasks. It features a decoder-only transformer architecture, utilizing 27 billion parameters, and supports context length processing of up to 8,192 tokens. The model incorporates innovative mechanisms like Grouped Query Attention and Sliding Window Attention to enhance efficiency and effectiveness in handling long texts. Its instruction-tuned variants are designed for improved interaction in conversational tasks, and it benefits from knowledge distillation techniques for enhanced performance. Additionally, Gemma 2 27B Instruct is openly accessible, promoting wider innovation in AI applications.

Model Specs

Released2024-06-27
Parameters27B
Context8K
ArchitectureDecoder Only

Provider

Arcee AI