Gemma 7B Instruct on Replicate API

Gemma · Google DeepMind

ServerlessOpen Weights

Last refreshed 2026-04-19. Next refresh: weekly.

Why use Gemma 7B Instruct on Replicate API?

Replicate API offers Gemma 7B Instruct with pay-as-you-go pricing at $0.05/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Compare Gemma 7B Instruct across 8 providers to find the best fit for your use case
Input / 1M
$0.050
Output / 1M
$0.25
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install replicate
Auth
export REPLICATE_API_TOKEN=...
Call
import replicate
output = replicate.run(
    "google-deepmind/gemma-7b-it",
    input={"prompt": "Hello"}
Model ID
google-deepmind/gemma-7b-it

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# google-deepmind/gemma-7b-it format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "google-deepmind/gemma-7b-it",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

  • Use provider model ID "google-deepmind/gemma-7b-it", not the LLMReference slug "gemma-7b-it".
  • Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
  • The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.

Compare Gemma 7B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM——
Fireworks AI$0.20$0.20
Together AI$0.20$0.20
GCP Vertex AI$0.10$0.30
Cloudflare Workers AI——
View all 8 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.05
Output tokens$0.25

Capabilities

Structured Outputs

About Gemma 7B Instruct

Gemma 7B Instruct is a cutting-edge large language model developed by Google DeepMind, boasting 7 billion parameters. As part of the Gemma family, it benefits from the advanced research underpinning Google's Gemini models. This model is optimized for text generation tasks, excelling in areas like question answering and summarization, and it is finely tuned to follow instructions effectively. Despite its compact size, Gemma 7B Instruct performs impressively on benchmarks, making it versatile for deployment across various hardware platforms, from laptops to cloud infrastructure.

Get Started