Last refreshed 2026-04-19. Next refresh: weekly.
Why use Gemma 2B Instruct on Replicate API?
Replicate API offers Gemma 2B Instruct with pay-as-you-go pricing at $0.05/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.
Compare Gemma 2B Instruct across 7 providers to find the best fit for your use caseSetup recipe
Python + curlpip install replicateexport REPLICATE_API_TOKEN=...import replicate
output = replicate.run(
"gemma-2b-it",
input={"prompt": "Hello"}gemma-2b-itRequest example
import replicate
# reads REPLICATE_API_TOKEN from env
# gemma-2b-it format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
"gemma-2b-it",
input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))Gotchas
- Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
- The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.
Compare Gemma 2B Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Together AI | $0.10 | $0.10 |
| GCP Vertex AI | $0.04 | $0.12 |
| Cloudflare Workers AI | — | — |
| NVIDIA NIM | — | — |
| Alibaba Cloud PAI-EAS | — | — |
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.05 |
| Output tokens | $0.25 |
Capabilities
About Gemma 2B Instruct
Gemma 2B Instruct is a large language model developed by Google, designed to balance performance and accessibility with its 2 billion parameters. Derived from the Gemini family, it excels in tasks such as text generation, code interpretation, and mathematical problem-solving. Built on a transformer decoder architecture, it features multi-query attention, RoPE, GeGLU activations, and RMSNorm. Trained on approximately 6 trillion tokens, including web documents, code, and mathematical content, it uses SFT and RLHF for instruction-tuning. Notable for its lightweight design permitting deployment on consumer-grade hardware, it's open-source and optimized for dialogue applications. Despite its capabilities, limitations include potential biases, factual inaccuracies, and challenges with complex reasoning.
FAQ
What does Gemma 2B Instruct cost on Replicate API?
On Replicate API, Gemma 2B Instruct costs $0.05 per 1M input tokens and $0.25 per 1M output tokens.
What is the context window for Gemma 2B Instruct on Replicate API?
Gemma 2B Instruct supports a 2,000 token context window on Replicate API.
How does Replicate API compare to other Gemma 2B Instruct providers?
Gemma 2B Instruct is available from 7 providers. The cheapest input pricing is $0.04/1M tokens from GCP Vertex AI.
Who created Gemma 2B Instruct?
Gemma 2B Instruct was created by Google DeepMind as part of the Gemma model family.
Is Gemma 2B Instruct open source?
Gemma 2B Instruct is open source according to the seed data.