LLM ReferenceLLM Reference
Replicate API

Gemma 7B Instruct on Replicate API

Gemma · Google DeepMind

ServerlessOpen Source

Last refreshed 2026-04-19. Next refresh: weekly.

Why use Gemma 7B Instruct on Replicate API?

Replicate API offers Gemma 7B Instruct with pay-as-you-go pricing at $0.05/1M input tokens. Replicate is a cloud-based platform that enables users to run machine learning models easily and efficiently.

Compare Gemma 7B Instruct across 8 providers to find the best fit for your use case
Input / 1M
$0.050
Output / 1M
$0.25
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install replicate
Auth
export REPLICATE_API_TOKEN=...
Call
import replicate
output = replicate.run(
    "gemma-7b-it",
    input={"prompt": "Hello"}
Model ID
gemma-7b-it

Request example

import replicate

# reads REPLICATE_API_TOKEN from env
# gemma-7b-it format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "gemma-7b-it",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Gotchas

  • Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
  • The examples expect REPLICATE_API_TOKEN; rename it only if your application config maps the new variable.

Compare Gemma 7B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Fireworks AI$0.20$0.20
Together AI$0.20$0.20
GCP Vertex AI$0.10$0.30
Cloudflare Workers AI
View all 8 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.05
Output tokens$0.25

Capabilities

Structured Outputs

About Gemma 7B Instruct

Gemma 7B Instruct is a cutting-edge large language model developed by Google DeepMind, boasting 7 billion parameters. As part of the Gemma family, it benefits from the advanced research underpinning Google's Gemini models. This model is optimized for text generation tasks, excelling in areas like question answering and summarization, and it is finely tuned to follow instructions effectively. Despite its compact size, Gemma 7B Instruct performs impressively on benchmarks, making it versatile for deployment across various hardware platforms, from laptops to cloud infrastructure. Moreover, it is open-source, with accessible weights and incorporates responsible AI practices, such as data filtering and human feedback, to ensure safe and ethical use.

FAQ

What does Gemma 7B Instruct cost on Replicate API?

On Replicate API, Gemma 7B Instruct costs $0.05 per 1M input tokens and $0.25 per 1M output tokens.

What is the context window for Gemma 7B Instruct on Replicate API?

Gemma 7B Instruct supports a 8,000 token context window on Replicate API.

How does Replicate API compare to other Gemma 7B Instruct providers?

Gemma 7B Instruct is available from 8 providers. The cheapest input pricing is $0.05/1M tokens from Replicate API.

Who created Gemma 7B Instruct?

Gemma 7B Instruct was created by Google DeepMind as part of the Gemma model family.

Is Gemma 7B Instruct open source?

Gemma 7B Instruct is open source according to the seed data.

Get Started

Model Specs

Released2024-02-21
Parameters7B
Context8K
ArchitectureDecoder Only
Knowledge cutoff2023-04

GPU-Hour Providers(1)

Related Models on Replicate API