Skip to content
Learn Motion
ExploreHow it worksMembership
Log in
Learn Motion

How ChatGPT Writes One Token at a Time

1From Your Words to Tokens2Predicting the Next Token3Choosing a Token and Looping4Why the Answer Reads as Coherent Text
Predicting the Next Token

Context Reshapes the Ranking

3 / 4
Here is the part that makes this a language model rather than a lookup table. The distribution you just saw is not fixed. It is conditional on the tokens that came before it.
0:00 / 0:00

The distribution is conditional on the tokens that came before it. Change an earlier token and the same model produces a different ranking of candidates. This is what it means to call the output a conditional probability: the probability of the next token given the preceding sequence. The model has no fixed answer stored for a prefix; the prefix itself determines which candidates rise.

Previous3 / 4Next

Learn Motion

Generate a course. Learn it properly.

Operated by Wuhan Daoyin Technology Co., Ltd.

Contact: [email protected]
Privacy PolicyTerms of Service

© 2026 Learn Motion