Yuanjian Chen

Temporally Heterogeneous Graph Contrastive Learning for Multimodal Acoustic Event Classification

Multimodal acoustic event classification plays a key role in audio-visual systems. Although combining audio and visual signals improves recognition, it is still difficult to align them over time and to reduce the effect of noise across modalities. Existing methods often treat audio and visual stream…