Skip to content
Learn Motion
ExploreHow it worksMembership
Log in
Learn Motion

How ChatGPT Writes One Token at a Time

1From Your Words to Tokens2Predicting the Next Token3Choosing a Token and Looping4Why the Answer Reads as Coherent Text
Predicting the Next Token

A Ranked Field, Not an Answer

4 / 4
So when the model finishes this step, what does it actually hand over? Not an answer. It hands over a ranked list of candidates, ordered by probability.
0:00 / 0:00

The model's output is a ranked distribution across the entire vocabulary, not a single stored answer. A few candidates hold most of the probability mass, and a long tail of thousands of entries holds a small share each. Because the output is a distribution, many tokens remain possible at every step, and the ranking is the model's entire contribution at this position.

Previous4 / 4Next

Learn Motion

Generate a course. Learn it properly.

Operated by Wuhan Daoyin Technology Co., Ltd.

Contact: [email protected]
Privacy PolicyTerms of Service

© 2026 Learn Motion