Using Gemma 2 27B Instruct on Replicate API
Implementation guide · Gemma 2 · Google DeepMind
Replicate API exposes Gemma 2 27B Instruct through model ID google-deepmind/gemma2-27b-it. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-04-19. Next refresh: weekly.
Quick Start
- 1
- 2Use the Replicate API SDK or REST API to call
google-deepmind/gemma2-27b-it— see the documentation for request format. - 3
Code Examples
pip install replicateREPLICATE_API_TOKENgoogle-deepmind/gemma2-27b-itReplicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
import replicate
# reads REPLICATE_API_TOKEN from env
# google-deepmind/gemma2-27b-it format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
"google-deepmind/gemma2-27b-it",
input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))Pricing on Replicate API
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.40 |
| Output tokens | $0.40 |
Capabilities
About Gemma 2 27B Instruct
Gemma 2 27B Instruct is a cutting-edge large language model from Google, excelling in text generation, question answering, summarization, and reasoning tasks. It features a decoder-only transformer architecture, utilizing 27 billion parameters, and supports context length processing of up to 8,192 tokens. The model incorporates innovative mechanisms like Grouped Query Attention and Sliding Window Attention to enhance efficiency and effectiveness in handling long texts. Its instruction-tuned variants are designed for improved interaction in conversational tasks, and it benefits from knowledge distillation techniques for enhanced performance. Additionally, Gemma 2 27B Instruct is openly accessible, promoting wider innovation in AI applications.