跳到主要内容
Learn Motion
探索课程产品能力价格

下载 Learn Motion

用手机扫描二维码,下载 App。

App Store

扫码从 App Store 下载 Learn Motion打开商店页面

Google Play

扫码从 Google Play 下载 Learn Motion打开商店页面
登录
Learn Motion

How Generative AI Creates Text, Images, and Videos from a Prompt

1The Shared Idea Behind All Generative AI2How a Prompt Becomes an Instruction3Generating Text: One Token at a Time4Generating Images: From Noise to Picture5Generating Video: Adding Time6Comparing the Three Modalities and Judging Outputs
Generating Video: Adding Time

A Video Is a Stack of Frames That Must Agree

1 / 3
Watch the frames advance one at a time. Each one is a complete picture on its own, but the sequence only works as video because the subject stays put. Notice what would happen if the model treated each frame as an independent request: the shape would wobble, the color would drift, and your eye would read it as flicker instead of motion. Carrying the subject forward from frame to frame is the whole difficulty.
0:00 / 0:00

A video is not a single picture that moves. It is a sequence of still images — frames — shown in order fast enough that the eye reads them as continuous motion. Typical video runs at roughly 24 to 30 frames per second, so even a short five-second clip contains well over a hundred separate images.

Each frame is the same kind of object the previous chapter dealt with: a rectangular grid of pixels holding numeric color values. So generating a video means generating many pixel grids in sequence rather than one. The refinement idea carries over directly — start from noise, adjust step by step under prompt guidance — but now the adjustment has to happen across the whole sequence at once.

This is where the new problem appears. If each frame were refined in isolation, the model would produce a hundred plausible pictures that happen to share a prompt but not a subject. A person's face would subtly change shape between frames; a shirt's color would shift; a background object would slide. The eye is extremely sensitive to this, so the requirement is not just that each frame looks good, but that consecutive frames describe the same world. That requirement is called temporal consistency, and it is the central challenge of video generation.

The practical consequence is that video models must carry information forward in time. Whatever the model decides about the subject in frame one constrains what it can decide in frame two, and so on down the sequence. The conditioning principle from earlier chapters still holds — the prompt steers the output — but it now steers a trajectory rather than a single point.

上一页1 / 3下一页

Learn Motion

生成课程,认真学会。

运营方:Wuhan Daoyin Technology Co., Ltd.

联系我们: [email protected]
隐私政策用户服务协议

© 2026 Learn Motion