LLM ReferenceLLM Reference
NVIDIA NIM

gpt-oss-120b on NVIDIA NIM

GPT-OSS · OpenAI

ServerlessOpen Source

Last refreshed 2026-05-01. Next refresh: weekly.

Why use gpt-oss-120b on NVIDIA NIM?

NVIDIA NIM offers gpt-oss-120b with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare gpt-oss-120b across 7 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: openai/gpt-oss-120b
Model ID
openai/gpt-oss-120b

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID openai/gpt-oss-120b.

Gotchas

  • Use provider model ID "openai/gpt-oss-120b", not the LLMReference slug "gpt-oss-120b".

Compare gpt-oss-120b Across Providers

ProviderInput (per 1M)Output (per 1M)
OpenRouter$0.04$0.18
Together AI$0.15$0.60
Fireworks AI$0.15$0.60
GCP Vertex AI$0.09$0.36
NVIDIA NIM
View all 7 providers →

Pricing

TypeRate
GPU Hour Rate$1.00/GPU·hr
GPU Config1xH100

Capabilities

Function CallingTool UseStructured Outputs

About gpt-oss-120b

OpenAI open-weight model with 120 billion parameters. Text-only model supporting reasoning, function calling, and structured outputs. Free for self-hosting. Released August 5, 2025.

FAQ

What is the context window for gpt-oss-120b on NVIDIA NIM?

gpt-oss-120b supports a 131,072 token context window on NVIDIA NIM.

How does NVIDIA NIM compare to other gpt-oss-120b providers?

gpt-oss-120b is available from 7 providers. The cheapest input pricing is $0.039/1M tokens from OpenRouter.

What API model ID do I use for gpt-oss-120b on NVIDIA NIM?

Use the model ID openai/gpt-oss-120b when calling NVIDIA NIM's API.

Who created gpt-oss-120b?

gpt-oss-120b was created by OpenAI as part of the GPT-OSS model family.

Is gpt-oss-120b open source?

gpt-oss-120b is open source according to the seed data.

Get Started

Model Specs

Released2025-08-05
Parameters120B
Context131K
ArchitectureDecoder Only
Knowledge cutoff2025-08

Related Models on NVIDIA NIM