Retrieval-augmented generation changes the order of operations. Instead of asking the model to answer from memory, the system first searches the document collection for the passages most relevant to the question, then places those passages next to the question and lets the model read them before answering. The model still generates the words, but now the evidence is in front of it.
How AI Answers Questions About Documents It Never Learned