Guanlin Feng

Neighbor GRPO: Contrastive ODE Policy Optimization Aligns Flow Models

Group Relative Policy Optimization (GRPO) has shown promise in aligning image and video generative models with human preferences. However, applying it to modern flow matching models is challenging because of its deterministic sampling paradigm. Current methods address this issue by converting Ordina