When a language model is asked about a document it never saw during training, it does not stay silent. It generates a fluent answer anyway, because generation always continues the text. The answer may sound authoritative while resting on no source at all. This is the failure mode that retrieval-augmented generation is designed to remove.
How AI Answers Questions About Documents It Never Learned