GPT-2

Released
2019-02-14
Last refreshed
2026-10-12
Status
Researched 139d ago
Open sourceCommercial use: permitted

GPT-2 is released 2019-02-14 in the GPT-2 family with open-source; evaluate it while provider pricing coverage matures.

OpenAI releases · 44 in the last 12 monthsChangelog →
Specifications
Family
GPT-2
Released
2019-02-14
Context
1K
Parameters
124M
Architecture
Decoder Only
Knowledge cutoff
2017-12
Specialization
general
Openness
Open source
License
MITOSI-approvedPermitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Cutting-edge research and development.

San Francisco, California, United States
Founded 2015
Website
Pricing

No tracked provider pricing is available yet.

About

GPT-2 is a language model from OpenAI. Its knowledge cutoff is 2017-12-01.

Overview

GPT-2 is the 124-million-parameter OpenAI GPT-2 checkpoint tracked by the openai-community/gpt2 model card. It is part of OpenAI's second-generation autoregressive language model family, released in February 2019, and uses a decoder-only transformer architecture trained on WebText, a corpus assembled from outbound links posted on Reddit. This row is the compact 124M GPT-2 entry with a 1,024-token context window, not the larger 355M, 774M, or 1.5B GPT-2 sibling checkpoints.

GPT-2 is a pure language model: it predicts the next token given a context, without instruction tuning, RLHF alignment, or safety filtering. Users interact with it through prompt continuation rather than explicit instruction, which means it produces text stylistically consistent with its training corpus rather than executing user commands. Training data has a knowledge cutoff of approximately December 2017. The model does not support tool use, function calling, multi-modal input, or structured output.

GPT-2 is primarily of research and educational interest today. It established key patterns for large-scale pretraining and demonstrated emergent zero-shot task performance at scale, but the 124M checkpoint is substantially outperformed on practical tasks by later instruction-tuned models and by the larger GPT-2 variants. The model and its weights are available under an MIT-equivalent license on Hugging Face and via Azure ML. For new applications, GPT-2 is useful as a lightweight research baseline or for small text-generation experiments where the absence of alignment is acceptable.

Providers

No active provider routes are tracked for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Compare GPT-2 with other models

Show all 38 popular comparisonssorted by 7-day search impressions