2025
Mitigating Pervasive Modality Absence Through Multimodal Generalization and Refinement
AAAI 2025technical
The performance of multimodal models often deteriorates when modality absence occurs. The absence disrupts the learned inter-modal correlations, resulting in biased multimodal representations. This challenge is especially pronounced when the absence is pervasive, affecting both the training and infe…