Using Gemma 2 9B Instruct on NVIDIA NIM

Implementation guide · Gemma 2 · Google DeepMind

ProvisionedOpen Weights

NVIDIA NIM exposes Gemma 2 9B Instruct through model ID gemma-2-9b-it. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call gemma-2-9b-it — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

Structured Outputs

About Gemma 2 9B Instruct

Gemma 2 9B Instruct, developed by Google, is a state-of-the-art large language model based on the advanced Gemini framework. It is a decoder-only transformer model with 9 billion parameters, offering a balance between size and performance. The model is trained on an expansive dataset comprising 8 trillion tokens, including web documents, code, and mathematical text, a notable 30% increase from its predecessor, Gemma 1.1. This allows it to adeptly handle diverse tasks such as question answering, creative writing, coding, and mathematical problem-solving.

Model Specs

Released2024-06-27
Parameters9B
Context8k
ArchitectureDecoder Only

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States