Standard Flow-GRPO applies the same advantage to all spatial regions of generated images, even though different areas contribute differently to the final reward. To fix this, the authors reformulate the log-likelihood into token-level terms and use gradients of the reward with respect to the image to create a continuous spatial credit map. This map is normalized with Median Absolute Deviation and temperature scaling to reduce noise, then used to scale the advantage for each token.
Experiments on the GenEval benchmark show that this method matches the fast convergence of top alignment methods like DiffusionNFT while significantly improving alignment over basic Flow-GRPO. The work is interesting because it exploits the patch-based architecture of to assign credit more precisely, without requiring hard segmentation or additional critic networks.