跳到主要内容
Learn Motion
探索课程产品能力价格

下载 Learn Motion

用手机扫描二维码,下载 App。

App Store

扫码从 App Store 下载 Learn Motion打开商店页面

Google Play

扫码从 Google Play 下载 Learn Motion打开商店页面
登录
Learn Motion

How Text-to-Video AI Works Under the Hood

1From Prompt to Conditioning Signal2Latent Diffusion: Generating Video in Compressed Space3Spatio-Temporal Attention: Keeping Frames Consistent4Where the Pipeline Breaks: Failure Modes and Their Causes
Spatio-Temporal Attention: Keeping Frames Consistent

Two Ways to Combine Space and Time

3 / 5
You can wire those two attentions together in more than one way. The common arrangement is factorized: run a spatial pass inside each frame, then a temporal pass down the stack. Two separate, cheaper operations.
0:00 / 0:00

Spatial and temporal attention can be arranged in two ways. Factorized attention runs them as separate passes: first each frame attends over its own patches, then each location attends over frames. Joint spatio-temporal attention instead lets every position attend to every other position across both space and time in a single operation. Joint attention can capture relationships that factorized attention misses, but its cost grows with the square of the total number of positions — frames multiplied by patches — so doubling the frame count roughly quadruples the work. Factorized attention keeps the two passes linear in their own dimension, which is why many video models use it.

参考资料

  1. [1]Video Diffusion Modelsarxiv.org
上一页3 / 5下一页

Learn Motion

生成课程,认真学会。

运营方:Wuhan Daoyin Technology Co., Ltd.

联系我们: [email protected]
隐私政策用户服务协议

© 2026 Learn Motion