跳到主要内容
Learn Motion
探索课程产品能力价格

下载 Learn Motion

用手机扫描二维码,下载 App。

App Store

扫码从 App Store 下载 Learn Motion打开商店页面

Google Play

扫码从 Google Play 下载 Learn Motion打开商店页面
登录
Learn Motion

How Generative AI Creates Text, Images, and Videos from a Prompt

1The Shared Idea Behind All Generative AI2How a Prompt Becomes an Instruction3Generating Text: One Token at a Time4Generating Images: From Noise to Picture5Generating Video: Adding Time6Comparing the Three Modalities and Judging Outputs
How a Prompt Becomes an Instruction

Text Is Cut Into Chunks, Not Letters

1 / 4
Look at how the sentence breaks apart. The common word stays as one block, but the longer, rarer word splits into smaller pieces, and the punctuation rides along with whatever chunk it touches. That splitting is not arbitrary: it is a compromise. Going letter by letter would make every sentence enormous and force the model to relearn that the letters c-a-t spell the same thing as the word cat. Going whole-word by whole-word would break on any word the model had never seen. Chunking lets common words stay whole while unfamiliar ones break into parts the model already recognizes. So when you write a prompt, remember that the model is counting chunks, not words.
0:00 / 0:00

A model never sees the string of characters you typed. Before anything else happens, the prompt is split into tokens, which are chunks of text roughly the size of a common word piece. A frequent word like "cat" may be one token, while a rarer word like "skateboard" may be split into two or three pieces such as "skate" and "board". Punctuation and spaces are usually attached to the neighboring chunk rather than standing alone.

The reason is practical. If a model worked character by character, a short sentence would become dozens of tiny steps and the model would have to relearn that c-a-t means the same thing as the word cat. If it worked whole-word by whole-word, it would need an entry for every inflected and misspelled form and would have no way to handle a word it had never seen. Chunking sits between those extremes: common words stay whole, unfamiliar words break into recognizable pieces, and the model can still make sense of a word it has never encountered by reading its parts.

The consequence for prompting is that the model does not perceive letters or spelling the way you do. It perceives a sequence of chunks. This is also why token counts, not word counts, are the real measure of how much text you have sent.

上一页1 / 4下一页

Learn Motion

生成课程,认真学会。

运营方:Wuhan Daoyin Technology Co., Ltd.

联系我们: [email protected]
隐私政策用户服务协议

© 2026 Learn Motion