Zixian Gao

Embracing Unimodal Aleatoric Uncertainty for Robust Multimodal Fusion

As a fundamental problem in multimodal learning multimodal fusion aims to compensate for the inherent limitations of a single modality. One challenge of multimodal fusion is that the unimodal data in their unique embedding space mostly contains potential noise which leads to corrupted cross-modal in…