SIPO: Stabilized and Improved Preference Optimization for Aligning Diffusion Models
Preference learning has garnered extensive attention as an effective technique for aligning diffusion models with human preferences in visual generation tasks. However, existing alignment approaches such as Diffusion-DPO suffer from two fundamental challenges: training instability caused by high gra…