The context window is the maximum sequence length a model architecture supports, determined by positional encoding, attention mechanism, and memory constraints. In 2026, context windows range from 2K to 10M+ tokens. Extending context requires innovations in positional encoding (RoPE scaling), efficient attention (sliding window, Flash Attention), and memory management.