gpt-oss-120b on NVIDIA NIM

GPT-OSS · OpenAI

ServerlessOpen Source

Last refreshed 2026-05-01. Next refresh: weekly.

Why use gpt-oss-120b on NVIDIA NIM?

NVIDIA NIM offers gpt-oss-120b with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare gpt-oss-120b across 13 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: openai/gpt-oss-120b
Model ID
openai/gpt-oss-120b

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID openai/gpt-oss-120b.

Gotchas

  • Use provider model ID "openai/gpt-oss-120b", not the LLMReference slug "gpt-oss-120b".

Compare gpt-oss-120b Across Providers

ProviderInput (per 1M)Output (per 1M)
Cloudflare Workers AI$0.35$0.75
OpenRouter$0.04$0.18
Together AI$0.15$0.60
Fireworks AI$0.15$0.60
GCP Vertex AI$0.09$0.36
View all 13 providers →

Capabilities

JSON / Tool useStructured Outputs

About gpt-oss-120b

OpenAI open-weight model with 120 billion parameters. Text-only model supporting reasoning, function calling, and structured outputs. Free for self-hosting. Released August 5, 2025.

Get Started

Model Specs

Released2025-08-05
Parameters120B
Context131k
ArchitectureDecoder Only
Knowledge cutoff2025-08

Related Models on NVIDIA NIM