← Search

Fengqiang Wan

4 accepted papers

2024

Facilitating Multimodal Classification via Dynamically Learning Modality Gap

NeurIPS 2024poster

Multimodal learning falls into the trap of the optimization dilemma due to the modality imbalance phenomenon, leading to unsatisfactory performance in real applications. A core reason for modality imbalance is that the models of each modality converge at different rates. Many attempts naturally focu…