Varshan Muhunthan

Multi-modal Data Spectrum: Multi-modal Datasets are Multi-dimensional

Understanding the interplay between intra-modality dependencies (the contribution of an individual modality to a target task) and inter-modality dependencies (the relationships between modalities and the target task) is fundamental to advancing multi-modal learning. However, the nature of and intera…