2025
AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models
ACL 2025finding
Existing multi-objective preference alignment methods for large language models (LLMs) face limitations: (1) the inability to effectively balance various preference dimensions, and (2) reliance on auxiliary reward/reference models introduces computational complexity. To address these challenges, we…