Retrieval can return chunks that are related to the question without containing the answer. In that case the grounded system should report that the answer was not found in the provided documents. Refusing is the correct outcome, because the alternative is a confident answer assembled from the model's own memory, which is exactly the failure that grounding is meant to prevent.
How AI Answers Questions About Documents It Never Learned