2024
Adversarial Preference Optimization: Enhancing Your Alignment via RM-LLM Game
ACL 2024findings
Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However, continuously updating LLMs for alignment raises a distribution gap be…