The retrieved chunks do not reach the model on their own. They are assembled together with the user's question and a grounding instruction into a single prompt. The context window is the fixed amount of text the model can read at one time, so the assembled prompt has to fit inside it. The order matters: the instruction comes first, then the retrieved chunks as the evidence, then the question the model must answer.
How AI Answers Questions About Documents It Never Learned
Grounded Generation: Answering From the Retrieved Text
Building the Final Prompt
1 / 4
The chunks are in hand, but they are still just loose passages sitting off to the side. Nothing has told the model what to do with them yet.
0:00 / 0:00