Skip to content
Learn Motion
ExploreHow it worksMembership
Log in
Learn Motion

How ChatGPT Writes One Token at a Time

1From Your Words to Tokens2Predicting the Next Token3Choosing a Token and Looping4Why the Answer Reads as Coherent Text
Why the Answer Reads as Coherent Text

The Prompt Sets the Starting Distribution

3 / 4
If plausibility is all that is being optimized, then the input has enormous leverage. The prompt is the first context the model sees, so it shapes the very first distribution.
0:00 / 0:00

Because every prediction is conditioned on the tokens that came before, the prompt is the first thing that shapes the distribution. A vague prompt leaves many continuations plausible, so the answer can wander; a specific prompt rules out most of them early, so the remaining path is narrower and the answer's direction is set from the first token onward. The prompt does not store an answer — it tilts the probabilities that the loop then follows.

Previous3 / 4Next

Learn Motion

Generate a course. Learn it properly.

Operated by Wuhan Daoyin Technology Co., Ltd.

Contact: [email protected]
Privacy PolicyTerms of Service

© 2026 Learn Motion