Using Gemma 2B Instruct on NVIDIA NIM

Implementation guide · Gemma · Google DeepMind

ProvisionedOpen Weights

NVIDIA NIM exposes Gemma 2B Instruct through model ID gemma-2b-it. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call gemma-2b-it — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricingModel Card

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

Structured Outputs

About Gemma 2B Instruct

Gemma 2B Instruct is a large language model developed by Google, designed to balance performance and accessibility with its 2 billion parameters. Derived from the Gemini family, it excels in tasks such as text generation, code interpretation, and mathematical problem-solving. Built on a transformer decoder architecture, it features multi-query attention, RoPE, GeGLU activations, and RMSNorm. Trained on approximately 6 trillion tokens, including web documents, code, and mathematical content, it uses SFT and RLHF for instruction-tuning. Notable for its lightweight design permitting deployment on consumer-grade hardware, it's open-source and optimized for dialogue applications.

Full model details →

Model Specs

Released2024-02-21
Parameters2B
Context2k
ArchitectureDecoder Only
Knowledge cutoff2023-04

More Models on NVIDIA NIM

Gemma 7B Instruct
All models on NVIDIA NIM →

Also available on(6)

GCP Vertex AI$0.04/1MReplicate API$0.05/1MTogether AI$0.10/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States