跳到主要内容
Learn Motion
探索课程产品能力价格

下载 Learn Motion

用手机扫描二维码,下载 App。

App Store

扫码从 App Store 下载 Learn Motion打开商店页面

Google Play

扫码从 Google Play 下载 Learn Motion打开商店页面
登录
Learn Motion

How Text-to-Video AI Works Under the Hood

1From Prompt to Conditioning Signal2Latent Diffusion: Generating Video in Compressed Space3Spatio-Temporal Attention: Keeping Frames Consistent4Where the Pipeline Breaks: Failure Modes and Their Causes
Latent Diffusion: Generating Video in Compressed Space

The Shape of the Latent

5 / 5
So what is actually inside that latent cube the whole loop has been sharpening? It is a four-dimensional tensor, and each axis means something specific.
0:00 / 0:00

The latent video is a four-dimensional tensor: frames, channels, height, and width. The frame axis is the temporal dimension — how many latent frames the clip contains, which after decoding becomes the number of visible frames. The channel axis holds the learned feature dimensions the VAE chose to represent the video. Height and width are the spatial dimensions of each latent frame, smaller than the pixel resolution by the VAE's compression factor. Every denoising step operates on this whole tensor, so the denoiser sees all frames and all spatial positions together. When the loop finishes, the VAE decoder expands the tensor back into pixel frames.

参考资料

  1. [1]High-Resolution Image Synthesis with Latent Diffusion Modelsarxiv.org
上一页5 / 5下一页

Learn Motion

生成课程,认真学会。

运营方:Wuhan Daoyin Technology Co., Ltd.

联系我们: [email protected]
隐私政策用户服务协议

© 2026 Learn Motion