Training large image-generating models called is slow. , where a frozen teacher guides student features, speeds this up. But current methods always use the same fixed layer, which is suboptimal because the best layer changes.
The authors propose AdaREPA, which picks which layer to guide at each step. It measures gradient compatibility between the main training objective and the alignment objective, and selects more compatible layers more often.
On ImageNet-256, AdaREPA improved generation quality. For the SiT-B/2 model, it reduced the unguided Frechet Inception Distance (FID) from 21.960 to 19.848. This shows adaptive guidance improves training without extra inference cost.
