Concepts & capability filters
capabilitybeginner
context length
Also known as: context window, window size
See matching models with benchmark scores and pricing.
Definition
Context length denotes the maximum number of tokens an LLM can process in a single input sequence, limiting the span of prior text it can attend to for generating coherent outputs. Extensions via architectural innovations like rotary embeddings increase this capacity, crucial for long-document tasks.