2025
Improving LLM Safety Alignment with Dual-Objective Optimization
ICML 2025poster
Existing training-time safety alignment techniques for large language models (LLMs) remain vulnerable to jailbreak attacks. Direct preference optimization (DPO), a widely deployed alignment method, exhibits limitations in both experimental and theoretical contexts as its loss function proves subopti…