Frequency-aware forecasting cuts diffusion transformer evaluations while preserving fidelity

SpecKCast tracks frequency components with uncertainty-aware Kalman filters, enabling reported speedups of up to 6 times without additional training.

Big Tech
Javad Rajabi · Hakki Can Karaimer · David B. Lindell · Babak Taati · Michael S. Brown

University of Toronto · Vector Institute · AI Center–Toronto, Samsung Electronics

Research Digest··2 min read
Rajabi et al.

The authors apply a two-dimensional discrete cosine transform to each diffusion transformer output, separating it into spatial-frequency coefficients.

§