跳到主要内容
Learn Motion
探索课程产品能力价格

下载 Learn Motion

用手机扫描二维码,下载 App。

App Store

扫码从 App Store 下载 Learn Motion打开商店页面

Google Play

扫码从 Google Play 下载 Learn Motion打开商店页面
登录
Learn Motion

How ChatGPT Writes One Token at a Time

1From Your Words to Tokens2Predicting the Next Token3Choosing a Token and Looping4Why the Answer Reads as Coherent Text
Predicting the Next Token

From Logits to Probabilities

2 / 4
Those logits can be any size, so a score of eight next to a score of two hundred tells you little on its own. To make them comparable, the model runs them through a function called softmax.
0:00 / 0:00

Logits are unbounded, so they cannot be read as likelihoods directly. Softmax converts them: it exponentiates each logit, which makes every value positive, then divides by the sum of all exponentiated values. The result is a probability distribution in which every value lies between zero and one and the whole set sums to exactly one. Now the numbers are comparable likelihoods rather than arbitrary scores.

上一页2 / 4下一页

Learn Motion

生成课程,认真学会。

运营方:Wuhan Daoyin Technology Co., Ltd.

联系我们: [email protected]
隐私政策用户服务协议

© 2026 Learn Motion