Using gpt-oss-120b on NVIDIA NIM

Implementation guide · GPT-OSS · OpenAI

ServerlessOpen Source

NVIDIA NIM exposes gpt-oss-120b through model ID openai/gpt-oss-120b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call openai/gpt-oss-120b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricing

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

JSON / Tool useStructured Outputs

About gpt-oss-120b

OpenAI open-weight model with 120 billion parameters. Text-only model supporting reasoning, function calling, and structured outputs. Free for self-hosting. Released August 5, 2025.

Full model details →

Model Specs

Released2025-08-05
Parameters120B
Context131k
ArchitectureDecoder Only
Knowledge cutoff2025-08

More Models on NVIDIA NIM

gpt-oss-20b
All models on NVIDIA NIM →

Also available on(12)

Open InferenceFree/1MOpenRouter$0.04/1MNovita AI$0.05/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States