LLM ReferenceLLM Reference
GCP Vertex AI

gpt-oss-120b on GCP Vertex AI

GPT-OSS · OpenAI

ServerlessOpen Source

Last refreshed 2026-05-11. Next refresh: weekly.

Why use gpt-oss-120b on GCP Vertex AI?

GCP Vertex AI offers gpt-oss-120b with pay-as-you-go pricing at $0.09/1M input tokens. Vertex AI is Google Cloud's managed AI platform, offering access to Gemini models and hundreds of partner models alongside tools for fine-tuning, grounding, vector search, and end-to-end MLOps pipelines.

Compare gpt-oss-120b across 7 providers to find the best fit for your use case
Input / 1M
$0.090
Output / 1M
$0.36
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install google-cloud-aiplatform
Auth
export GOOGLE_CLOUD_PROJECT=...
Call
import os
import vertexai
from vertexai.generative_models import GenerativeModel
vertexai.init(project=os.environ["GOOGLE_CLOUD_PROJECT"], location="us-central1")
Model ID
gpt-oss-120b

Request example

import os
import vertexai
from vertexai.generative_models import GenerativeModel

# Reads GOOGLE_CLOUD_PROJECT from env; authenticates via Application Default Credentials
vertexai.init(project=os.environ["GOOGLE_CLOUD_PROJECT"], location="us-central1")
model = GenerativeModel("gpt-oss-120b")
response = model.generate_content("Hello")
print(response.text)

Gotchas

  • For Google-published models use the model name directly, e.g. "gemini-2.0-flash-001". For third-party publishers (Anthropic, Meta, etc.) use the full publisher path, e.g. "publishers/anthropic/models/claude-3-5-sonnet-v2@20241022".
  • The examples expect GOOGLE_CLOUD_PROJECT; rename it only if your application config maps the new variable.

Compare gpt-oss-120b Across Providers

ProviderInput (per 1M)Output (per 1M)
OpenRouter$0.04$0.18
Together AI$0.15$0.60
Fireworks AI$0.15$0.60
GCP Vertex AI$0.09$0.36
NVIDIA NIM
View all 7 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.09
Output tokens$0.36

Capabilities

Function CallingTool UseStructured Outputs

About gpt-oss-120b

OpenAI open-weight model with 120 billion parameters. Text-only model supporting reasoning, function calling, and structured outputs. Free for self-hosting. Released August 5, 2025.

FAQ

What does gpt-oss-120b cost on GCP Vertex AI?

On GCP Vertex AI, gpt-oss-120b costs $0.09 per 1M input tokens and $0.36 per 1M output tokens.

What is the context window for gpt-oss-120b on GCP Vertex AI?

gpt-oss-120b supports a 131,072 token context window on GCP Vertex AI.

How does GCP Vertex AI compare to other gpt-oss-120b providers?

gpt-oss-120b is available from 7 providers. The cheapest input pricing is $0.039/1M tokens from OpenRouter.

Who created gpt-oss-120b?

gpt-oss-120b was created by OpenAI as part of the GPT-OSS model family.

Is gpt-oss-120b open source?

gpt-oss-120b is open source according to the seed data.

Get Started

Model Specs

Released2025-08-05
Parameters120B
Context131K
ArchitectureDecoder Only
Knowledge cutoff2025-08

GPU-Hour Providers(1)

Related Models on GCP Vertex AI

Provider

GCP Vertex AI
GCP Vertex AI

Google Cloud Platform (GCP)

All models on GCP Vertex AI