2026
Risk Awareness Injection: Calibrating Vision-Language Models for Safety without Compromising Utility
ICML 2026poster
Vision language models (VLMs) extend the reasoning capabilities of large language models (LLMs) to cross-modal settings, yet remain highly vulnerable to multimodal jailbreak attacks. Existing defenses predominantly rely on safety fine-tuning or \textit{aggressive} token manipulations, incurring subs…