Standard diffusion degrades when transferring from a large teacher to a smaller student, producing corrupted regions and losing fine textures. The proposed Fixed-State KL measures this student-teacher distribution gap on shared evaluation states drawn from teacher trajectories and noise-corrupted real images.
The analysis attributes the failure to classifier-free guidance, which amplifies mismatches in the student’s conditional and unconditional predictions over the sampling trajectory. GFD-OPD instead absorbs the teacher’s guided policy directly into the student’s conditional branch. The reported experiments show fewer artifacts, greater training efficiency, and better final performance than prior baselines across all evaluated benchmarks.