跳到主要内容
Learn Motion
探索课程产品能力价格

下载 Learn Motion

用手机扫描二维码,下载 App。

App Store

扫码从 App Store 下载 Learn Motion打开商店页面

Google Play

扫码从 Google Play 下载 Learn Motion打开商店页面
登录
Learn Motion

How Text-to-Video AI Works Under the Hood

1From Prompt to Conditioning Signal2Latent Diffusion: Generating Video in Compressed Space3Spatio-Temporal Attention: Keeping Frames Consistent4Where the Pipeline Breaks: Failure Modes and Their Causes
From Prompt to Conditioning Signal

Sequence Versus Summary

3 / 4
Here is a fork in the road. Some systems keep that whole sequence. Others also collapse it into one pooled vector, a single summary of the entire prompt.
0:00 / 0:00

Alongside the per-token sequence, many systems also produce a pooled vector — a single summary of the whole prompt, often taken from a special start-of-sequence token or by averaging. The pooled vector is cheap and captures overall gist, which is useful for global control. But it cannot tell the generator which region of the frame should contain the boat and which should contain the rain. The per-token sequence preserves that binding; the pooled vector throws it away.

参考资料

  1. [1]CLIP: Connecting Text and Images (Radford et al., 2021)arxiv.org
上一页3 / 4下一页

Learn Motion

生成课程,认真学会。

运营方:Wuhan Daoyin Technology Co., Ltd.

联系我们: [email protected]
隐私政策用户服务协议

© 2026 Learn Motion