Fitting Inside the Window

The prompt's tokens form one ordered input sequence, and that sequence must fit inside the context window, the maximum number of tokens the model can attend to at once. When the sequence reaches that limit, no further tokens can be added, so long conversations must be trimmed or summarized to stay within the bound.