2026
Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMs
ICLR 2026poster
Direct Preference Optimization (DPO) has emerged as a cornerstone of reinforcement learning from human feedback (RLHF) due to its simplicity and efficiency. However, existing DPO-based methods typically treat all preference pairs equally, overlooking substantial variations in data quality and learni…