Skip to content
Learn Motion
ExploreHow it worksMembership
Log in
Learn Motion

How ChatGPT Writes One Token at a Time

1From Your Words to Tokens2Predicting the Next Token3Choosing a Token and Looping4Why the Answer Reads as Coherent Text
Why the Answer Reads as Coherent Text

One Mechanism, Three Failure Shapes

4 / 4
Once the prompt has set the direction, the same mechanism can go wrong in a few recognizable ways. They look like different problems, but they share one cause.
0:00 / 0:00

Repetition, drift, and confident fabrication all come from the same loop. Repetition appears when the accumulated context makes the same token the most plausible continuation again. Drift appears when a slightly off-token choice becomes context that pulls the following predictions further from the original direction. Confident fabrication appears when a plausible-sounding continuation is selected and then treated as established context by everything after it. None of these require a separate fault; each is the next-token mechanism running normally.

Previous4 / 4Complete

Learn Motion

Generate a course. Learn it properly.

Operated by Wuhan Daoyin Technology Co., Ltd.

Contact: [email protected]
Privacy PolicyTerms of Service

© 2026 Learn Motion