11 papers this week in Theory12 active threadsbusiest: Alignment Training Dynamics

Theory research

Generative media

Bottlenecked diffusion models predict best when targeting clean data, not noise

The authors systematically analyze how the choice of prediction target and loss space affects denoising diffusion models, both theoretically and empirically. They show that under a rank-deficient bottleneck, noise and velocity prediction incur an irreducible squared-error floor that clean-data prediction avoids. Experiments across CIFAR-10, Imagenette, and ImageNet-256 confirm that noise-prediction errors match the theoretical bound, while clean-data prediction exploits low-dimensional data structure.

6 days ago