Concepts & capability filters
capabilitybeginner
context length
Context length denotes the maximum number of tokens an LLM can process in a single input sequence, limiting the span of prior text it can attend to for generating coherent outputs.
- Category
- capability
- Difficulty
- beginner
- Aliases
- context window, window size
- Last reviewed
- 2026-05-15
Key facts
- Extensions via architectural innovations like rotary embeddings increase this capacity, crucial for long-document tasks.